00000001:02000400:3.0F:1788844337.926873:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_hostid 00000001:02000400:3.0:1788844360.264689:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788844362.261206:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 491 MB/s 00000001:01000000:3.0:1788844362.510697:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 623 MB/s 00000001:01000000:1.0F:1788844362.760595:0:3241:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3787 MB/s 00000020:02000000:3.0:1788844363.945006:0:3274:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_111_g33f3974 00000400:02000000:0.0F:1788844364.959308:0:3289:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.143@tcp [8/256/0/180] 00008000:02000000:2.0:1788844368.775865:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788844424.339694:0:5240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788844436.597676:0:5820:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788844436.597682:0:5820:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788844436.597847:0:5820:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000064781db6 00000080:02000400:3.0:1788844436.597858:0:5820:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788844436.603135:0:5820:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788844436.603152:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788844436.604092:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ea11af2b) 00000020:00000080:0.0:1788844436.604118:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788844436.617265:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788844436.617836:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788844436.641917:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788844436.641953:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788844436.641973:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788844436.642022:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788844436.642047:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788844436.643113:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788844436.643122:0:5820:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788844436.643134:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2d8f47 00000020:01000004:3.0:1788844436.643145:0:5820:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788844436.643151:0:5820:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788844436.643157:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000064781db6 from MGS 00000020:01000004:3.0:1788844436.643162:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788844436.643184:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d3153758) 00000020:00000080:3.0:1788844436.643197:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788844436.643381:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000064781db6 from MGS, refs=2 00080000:01000000:3.0:1788844436.643387:0:5820:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788844436.643394:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2d8f55 00000100:00100000:3.0:1788844436.643501:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788844436.643710:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788844436.643721:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788844436.644488:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788844436.644496:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788844436.645705:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788844436.645924:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788844436.645929:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788844436.646532:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788844436.646565:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788844436.647908:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788844436.647918:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788844436.649745:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844436.649751:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844436.649753:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844436.650114:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844436.650117:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844436.650119:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844436.650706:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788844436.653204:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788844436.900771:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4463 MB/s 00000001:01000000:3.0:1788844437.150655:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6155 MB/s 00000001:01000000:2.0:1788844437.401100:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1127 MB/s 00000001:01000000:3.0:1788844437.651308:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 963 MB/s 00080000:10000000:2.0:1788844437.678415:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1788844437.690145:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788844437.708294:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788844437.708312:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788844437.708314:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788844437.709240:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788844437.709310:0:5820:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788844437.709353:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788844437.709612:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788844437.709767:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788844437.710186:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788844437.710378:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788844437.710385:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788844437.723119:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788844437.723136:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788844437.724203:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788844437.724213:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788844437.725848:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788844437.725875:0:5820:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.143@tcp' 00000020:01000004:1.0:1788844437.725877:0:5820:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788844437.725930:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.143@tcp (typ=mgc) 00000020:00000080:1.0:1788844437.725949:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.143@tcp (00000000b4f39eed) 00000020:00000080:1.0:1788844437.725966:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1788844437.726946:0:5835:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1788844437.728413:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008732a226@MGC192.168.204.143@tcp: add connection 192.168.204.143@tcp at head 00010000:00010000:1.0:1788844437.728615:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.143@tcp-0 is initialized 00000040:01000000:1.0:1788844437.728625:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788844437.732445:0:5836:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788844437.732755:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.143@tcp (uuid 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed) 00000020:00000080:3.0:1788844437.732799:0:5820:0:(genops.c:1385:class_connect()) connect: client 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed, cookie 0x7f1093851e2d8f63 00000100:00080000:3.0:1788844437.732814:0:5820:0:(import.c:510:import_select_connection()) MGC192.168.204.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788844437.732819:0:5820:0:(import.c:624:import_select_connection()) MGC192.168.204.143@tcp: import 000000008732a226 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1788844437.732875:0:5820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000881a08c8 x1875739267825792/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788844437.732900:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed->MGS 00000020:01000004:3.0:1788844437.732919:0:5820:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788844437.732929:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788844437.732945:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000135bb2bd) 00000020:00000080:3.0:1788844437.732957:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788844437.733245:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000881a08c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3304:1875739267825792:0@lo:250: 00000100:00100000:0.0:1788844437.733314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844437.733610:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267825792 00000100:00100000:1.0:1788844437.733617:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267825792 00000100:00100000:1.0:1788844437.733721:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788844437.733728:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009f449fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1875739267825792:12345-0@lo:250: 00010000:00080000:1.0:1788844437.733748:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:1.0:1788844437.733769:0:5831:0:(genops.c:1385:class_connect()) connect: client 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed, cookie 0x7f1093851e2d8f71 00000100:00080000:1.0:1788844437.733910:0:5831:0:(import.c:65:import_set_state_nolock()) 00000000cc4fb649 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788844437.733983:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009f449fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:3304:x1875739267825792:12345-0@lo:250: Request processed in 254us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844437.733990:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844437.734211:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788844437.734219:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.143@tcp: connect to target with instance 0 00000100:00080000:0.0:1788844437.734227:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788844437.734232:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788844437.734235:0:3304:0:(import.c:65:import_set_state_nolock()) 000000008732a226 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788844437.734237:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788844437.734248:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788844437.734252:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000881a08c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3304:1875739267825792:0@lo:250: 00000100:00100000:0.0:1788844437.762520:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788844437.762895:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788844437.762901:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788844437.764285:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788844437.764298:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788844437.765399:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788844437.765409:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788844437.766385:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788844437.766878:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788844437.766884:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788844437.767497:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788844437.767505:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788844437.829348:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788844437.829672:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788844437.829679:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788844437.832211:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788844437.832227:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788844437.833096:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788844437.833318:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788844437.833324:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788844437.834101:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788844437.834109:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788844437.836391:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788844437.837284:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788844437.837293:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788844437.838092:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788844437.838101:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788844437.839999:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788844437.840242:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788844437.840248:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788844437.840950:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788844437.840959:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788844437.899897:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788844437.900123:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788844437.901400:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788844437.908488:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788844437.908511:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788844437.909465:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788844437.909476:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788844437.911084:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788844437.911109:0:5820:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788844437.911117:0:5820:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788844437.911258:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788844437.911291:0:5820:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.143@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788844437.911295:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788844437.911297:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788844437.911299:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788844437.911300:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788844437.911301:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788844437.911302:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788844437.911303:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788844437.911305:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788844437.911306:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788844437.911307:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788844437.911309:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788844437.911310:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788844437.911312:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788844437.911314:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788844437.911315:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788844437.911316:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788844437.911317:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788844437.911318:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788844437.911319:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788844437.911320:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788844437.911327:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788844437.911327:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788844437.911328:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788844437.911329:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788844437.911330:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788844437.911372:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788844437.911388:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000dda1ba9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267825920:0@lo:253: 00000100:00100000:2.0:1788844437.911460:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844437.911507:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e964dd8 going to sleep for 11 seconds 00000100:00100000:1.0:1788844437.911712:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267825920 00000100:00100000:1.0:1788844437.911720:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267825920 00000100:00100000:1.0:1788844437.911763:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788844437.911771:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039e74a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:5820:x1875739267825920:12345-0@lo:253: 20000000:01000000:1.0:1788844437.911826:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788844437.911829:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788844437.912362:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788844437.912417:0:5834:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788844437.912727:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788844437.913704:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788844437.914034:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788844437.914039:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788844437.914045:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788844437.914048:0:5834:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788844437.914062:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788844437.914264:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788844437.914503:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788844437.914516:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788844437.914615:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788844437.914665:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788844437.914702:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788844437.916087:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788844437.916108:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788844437.917025:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788844437.917039:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788844437.917074:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788844437.917083:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788844437.917114:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788844437.917479:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788844437.917699:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788844437.917707:0:5834:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788844437.917726:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788844437.918369:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788844437.918386:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788844437.918446:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788844437.918484:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788844437.918564:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788844437.918578:0:5834:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788844437.918669:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788844437.918678:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788844437.918736:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788844437.918772:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788844437.918821:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788844437.918832:0:5834:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788844437.920357:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788844437.920378:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788844437.920413:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788844437.920445:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788844437.925620:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788844437.925695:0:5834:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788844437.925703:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788844437.934976:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788844437.936218:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788844437.936247:0:5834:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.143@tcp for mdt 20000000:01000000:1.0:1788844437.936249:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.143@tcp (null) (null) (null) 00000040:00080000:1.0:1788844437.936295:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788844437.936303:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788844437.936333:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788844437.936340:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.143@tcp (null) (null) 00000040:00080000:1.0:1788844437.936376:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788844437.936384:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788844437.936414:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788844437.936451:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788844437.936522:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788844437.936525:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788844437.936531:0:5834:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788844437.936566:0:5834:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788844437.937358:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788844437.937488:0:5834:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788844437.954743:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788844437.954812:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788844437.954894:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788844437.954917:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788844437.954920:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788844437.954924:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788844437.954940:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788844437.954943:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788844437.954977:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788844437.954979:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788844437.962085:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788844437.962457:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788844437.962508:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788844437.962613:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1788844437.962629:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788844437.962632:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788844437.968171:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788844437.971717:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788844437.971778:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788844437.971857:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788844437.971876:0:5834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788844437.971879:0:5834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1788844437.971887:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788844437.971908:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844437.971924:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844437.971933:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844437.971939:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844437.971945:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844437.971951:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844437.971957:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cf75afae already unused, calling callback (00000000a8ab23c6) 00010000:00010000:1.0:1788844437.971967:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844437.971975:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844437.971989:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844437.971996:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844437.972002:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cf75afae/0x7f1093851e2d8f78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788844437.972020:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788844438.200020:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039e74a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:5820:x1875739267825920:12345-0@lo:253: Request processed in 288243us (288553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844438.200035:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788844438.200142:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000dda1ba9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267825920:0@lo:253: 10000000:01000000:3.0:1788844438.200157:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788844438.200161:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788844438.200163:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788844438.200164:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844438.200166:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788844438.200167:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844438.200168:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844438.200170:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788844438.200171:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788844438.200172:0:5820:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788844438.200174:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844438.200175:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788844438.200210:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000064781db6 from lustre-MDT0000 10000000:01000000:3.0:1788844438.200237:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788844438.200240:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788844438.200244:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91eed850cd28 10000000:01000000:3.0:1788844438.200249:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788844438.200256:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91eed850cd28 from 1 10000000:01000000:3.0:1788844438.200259:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788844438.200362:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 00000000bc2cb6ae/0x7f1093851e2d8f7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.200373:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 00000000bc2cb6ae/0x7f1093851e2d8f7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.200382:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 00000000bc2cb6ae/0x7f1093851e2d8f7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844438.200401:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826048:0@lo:101: 00000100:00100000:3.0:1788844438.200454:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.200579:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6400360 going to sleep for 11 seconds 00000100:00100000:0.0:1788844438.200688:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267826048 00000100:00100000:0.0:1788844438.200695:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267826048 00000100:00100000:0.0:1788844438.200766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788844438.200773:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc9e61a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:5820:x1875739267826048:12345-0@lo:101: 00010000:00010000:0.0:1788844438.200794:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844438.200807:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a98b7b93/0x7f1093851e2d8f86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d8f7f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844438.200829:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a98b7b93/0x7f1093851e2d8f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d8f7f expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844438.200840:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a98b7b93/0x7f1093851e2d8f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d8f7f expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844438.200848:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a98b7b93, rc 0) 00000100:00100000:0.0:1788844438.200953:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc9e61a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+6:5820:x1875739267826048:12345-0@lo:101: Request processed in 180us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844438.200959:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788844438.201022:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826048:0@lo:101: 00010000:00010000:3.0:1788844438.201034:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 00000000bc2cb6ae/0x7f1093851e2d8f7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.201042:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 00000000bc2cb6ae/0x7f1093851e2d8f7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844438.201086:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826176:0@lo:501: 00000100:00100000:3.0:1788844438.201111:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.201179:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6400360 going to sleep for 11 seconds 00000100:00100000:2.0:1788844438.201244:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267826176 00000100:00100000:2.0:1788844438.201249:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267826176 00000100:00100000:2.0:1788844438.201292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788844438.201298:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee81b002 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+6:5820:x1875739267826176:12345-0@lo:501: 00000100:00100000:2.0:1788844438.201517:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee81b002 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+6:5820:x1875739267826176:12345-0@lo:501: Request processed in 219us (405us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788844438.201524:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788844438.201675:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826176:0@lo:501: 10000000:01000000:3.0:1788844438.201710:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788844438.201728:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 00000000bc2cb6ae/0x7f1093851e2d8f7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.201736:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 00000000bc2cb6ae/0x7f1093851e2d8f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844438.201744:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91eed0c68800 10000000:01000000:3.0:1788844438.201748:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788844438.201751:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91eed0c68800 10000000:01000000:3.0:1788844438.201754:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788844438.201757:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91eed0c68800 from 1 10000000:01000000:3.0:1788844438.201759:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788844438.201786:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 00000000bdaf6273/0x7f1093851e2d8f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.201792:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 00000000bdaf6273/0x7f1093851e2d8f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.201798:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 00000000bdaf6273/0x7f1093851e2d8f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844438.201809:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826304:0@lo:101: 00000100:00100000:3.0:1788844438.201833:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.201850:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6400360 going to sleep for 11 seconds 00000100:00100000:2.0:1788844438.201967:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267826304 00000100:00100000:2.0:1788844438.201972:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267826304 00000100:00100000:2.0:1788844438.201990:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788844438.201994:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074c6e621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+6:5820:x1875739267826304:12345-0@lo:101: 00010000:00010000:2.0:1788844438.202002:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844438.202012:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000433130b0/0x7f1093851e2d8f94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d8f8d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.202025:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000433130b0/0x7f1093851e2d8f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d8f8d expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.202043:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000433130b0/0x7f1093851e2d8f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d8f8d expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.202049:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000433130b0, rc 0) 00000100:00100000:2.0:1788844438.202079:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074c6e621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+7:5820:x1875739267826304:12345-0@lo:101: Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844438.202085:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788844438.202153:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826304:0@lo:101: 00010000:00010000:3.0:1788844438.202161:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 00000000bdaf6273/0x7f1093851e2d8f8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.202176:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 00000000bdaf6273/0x7f1093851e2d8f8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844438.202187:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788844438.202200:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 00000000bdaf6273/0x7f1093851e2d8f8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.202205:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 00000000bdaf6273/0x7f1093851e2d8f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844438.202211:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788844438.202214:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788844438.202218:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91eed0c68800 10000000:01000000:3.0:1788844438.202220:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788844438.202222:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788844438.202224:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788844438.202235:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 00000000a1159987/0x7f1093851e2d8f9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.202241:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 00000000a1159987/0x7f1093851e2d8f9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.202246:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 00000000a1159987/0x7f1093851e2d8f9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844438.202255:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826432:0@lo:101: 00000100:00100000:3.0:1788844438.202287:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.202296:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6400360 going to sleep for 11 seconds 00000100:00100000:2.0:1788844438.202394:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267826432 00000100:00100000:2.0:1788844438.202398:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267826432 00000100:00100000:2.0:1788844438.202413:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844438.202418:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c23561a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+7:5820:x1875739267826432:12345-0@lo:101: 00010000:00010000:2.0:1788844438.202424:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844438.202430:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d650f533/0x7f1093851e2d8fa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d8f9b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.202441:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d650f533/0x7f1093851e2d8fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d8f9b expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.202447:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d650f533/0x7f1093851e2d8fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d8f9b expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.202453:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d650f533, rc 0) 00000100:00100000:2.0:1788844438.202483:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c23561a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+8:5820:x1875739267826432:12345-0@lo:101: Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844438.202489:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788844438.202569:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826432:0@lo:101: 00010000:00010000:3.0:1788844438.202578:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 00000000a1159987/0x7f1093851e2d8f9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.202584:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 00000000a1159987/0x7f1093851e2d8f9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844438.202620:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826560:0@lo:501: 00000100:00100000:3.0:1788844438.202643:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.202652:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6400360 going to sleep for 11 seconds 00000100:00100000:2.0:1788844438.202704:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267826560 00000100:00100000:2.0:1788844438.202708:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267826560 00000100:00100000:2.0:1788844438.202724:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788844438.202736:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017c3e3fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+8:5820:x1875739267826560:12345-0@lo:501: 00000100:00100000:2.0:1788844438.202998:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017c3e3fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:5820:x1875739267826560:12345-0@lo:501: Request processed in 262us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844438.203005:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788844438.203183:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826560:0@lo:501: 00000100:00100000:3.0:1788844438.203210:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826688:0@lo:503: 00000100:00100000:3.0:1788844438.203248:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.203350:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6400360 going to sleep for 11 seconds 00000100:00100000:2.0:1788844438.203401:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267826688 00000100:00100000:2.0:1788844438.203406:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267826688 00000100:00100000:2.0:1788844438.203436:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788844438.203442:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000276cf7a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:5820:x1875739267826688:12345-0@lo:503: 00000100:00100000:2.0:1788844438.203691:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000276cf7a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:5820:x1875739267826688:12345-0@lo:503: Request processed in 249us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844438.203698:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788844438.203941:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267826688:0@lo:503: 00000100:00100000:1.0:1788844438.204400:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d70a2caf pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5862:1875739267826816:0@lo:502: 00000100:00100000:1.0:1788844438.204444:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844438.204514:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 00000000221819ba going to sleep for 11 seconds 00000100:00100000:0.0:1788844438.204615:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267826816 00000100:00100000:0.0:1788844438.204620:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267826816 00000100:00100000:1.0:1788844438.204753:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788844438.204761:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ffc3533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:5862:x1875739267826816:12345-0@lo:502: 00000100:00100000:1.0:1788844438.205028:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ffc3533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:5862:x1875739267826816:12345-0@lo:502: Request processed in 268us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844438.205036:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788844438.205105:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d70a2caf pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5862:1875739267826816:0@lo:502: 00000020:01000000:3.0:1788844438.205129:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844438.205140:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844438.205143:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788844438.205148:0:5862:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788844438.205152:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788844438.205166:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000409cf754) 00000020:00000080:3.0:1788844438.205183:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788844438.205189:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788844438.205285:0:5862:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788844438.205292:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2d8fb0 00000020:00000080:3.0:1788844438.205532:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788844438.205556:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844438.205563:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844438.205565:0:5862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788844438.205568:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844438.205571:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844438.205572:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788844438.205575:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788844438.205584:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000fde87ac6) 00000020:00000080:3.0:1788844438.205593:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788844438.205597:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788844438.205598:0:5862:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788844438.205601:0:5862:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788844438.205606:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788844438.205645:0:5862:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000064781db6 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788844438.205667:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000243078c) 00000020:00000080:3.0:1788844438.205675:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788844438.205721:0:5862:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788844438.205726:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7f1093851e2d8fc5 00000020:00000080:3.0:1788844438.205821:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788844438.205826:0:5862:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788844438.205830:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7f1093851e2d8fcc 00080000:01000000:3.0:1788844438.205834:0:5862:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788844438.205836:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2d8fd3 00080000:10000000:3.0:1788844438.206445:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788844438.206910:0:5862:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788844438.212512:0:5862:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788844438.294699:0:5862:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788844438.295199:0:5862:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788844438.298632:0:5862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788844438.298966:0:5862:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788844438.327759:0:5862:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000077ead267) 00000020:00000080:3.0:1788844438.327791:0:5862:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788844438.327864:0:5862:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788844438.331012:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2d8fe1 00000020:00000080:1.0:1788844438.332073:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788844438.333633:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788844438.377123:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788844438.406599:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788844438.437940:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788844438.477161:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788844438.515212:0:5862:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788844438.544954:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7f1093851e2d8fe8 00000020:00000080:2.0:1788844438.545510:0:5862:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788844438.545524:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788844438.545531:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844438.545533:0:5862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788844438.545553:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788844438.545560:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844438.545561:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788844438.545565:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788844438.545601:0:5862:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788844438.545616:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788844438.545619:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844438.545620:0:5862:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788844438.545622:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788844438.545625:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844438.545626:0:5862:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788844438.545629:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788844438.545630:0:5862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788844438.545672:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d18db7cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5862:1875739267826944:0@lo:502: 00000100:00100000:2.0:1788844438.545825:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844438.545929:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee4d0ace going to sleep for 11 seconds 00000100:00100000:0.0:1788844438.546222:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267826944 00000100:00100000:0.0:1788844438.546239:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267826944 00000100:00100000:0.0:1788844438.546392:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788844438.546402:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071819915 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:5862:x1875739267826944:12345-0@lo:502: 00000100:00100000:0.0:1788844438.546967:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071819915 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:5862:x1875739267826944:12345-0@lo:502: Request processed in 565us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844438.546976:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788844438.547077:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d18db7cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5862:1875739267826944:0@lo:502: 00000020:01000000:3.0:1788844438.547111:0:5862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844438.547119:0:5862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844438.547121:0:5862:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788844438.547125:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788844438.547246:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788844438.547281:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788844438.547296:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 00000000a1159987/0x7f1093851e2d8f9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.547307:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 00000000a1159987/0x7f1093851e2d8f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844438.547316:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eed0c68800 from 1 10000000:01000000:3.0:1788844438.547320:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788844438.547348:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.547355:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.547365:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844438.547379:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827072:0@lo:101: 00000100:00100000:3.0:1788844438.547413:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.547863:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000319ead7e going to sleep for 11 seconds 00000100:00100000:2.0:1788844438.547944:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267827072 00000100:00100000:2.0:1788844438.547951:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267827072 00000100:00100000:2.0:1788844438.547979:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788844438.547986:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af9e4deb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:5820:x1875739267827072:12345-0@lo:101: 00010000:00010000:2.0:1788844438.547997:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844438.548011:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000003d4cb36/0x7f1093851e2d8ff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d8fef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.548032:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003d4cb36/0x7f1093851e2d8ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d8fef expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.548041:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000003d4cb36/0x7f1093851e2d8ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d8fef expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.548049:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000003d4cb36, rc 0) 00000100:00100000:2.0:1788844438.548091:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af9e4deb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+10:5820:x1875739267827072:12345-0@lo:101: Request processed in 105us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844438.548097:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788844438.548169:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827072:0@lo:101: 00010000:00010000:3.0:1788844438.548196:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.548205:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844438.548948:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827200:0@lo:256: 00000100:00100000:3.0:1788844438.548999:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.549028:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000319ead7e going to sleep for 11 seconds 00000100:00100000:2.0:1788844438.549097:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267827200 00000100:00100000:2.0:1788844438.549103:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267827200 00000100:00100000:2.0:1788844438.549127:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788844438.549132:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a67fa49e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+10:5820:x1875739267827200:12345-0@lo:256: 20000000:01000000:2.0:1788844438.549149:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788844438.549155:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788844438.549223:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a67fa49e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+10:5820:x1875739267827200:12345-0@lo:256: Request processed in 91us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844438.549230:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788844438.549340:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827200:0@lo:256: 10000000:01000000:3.0:1788844438.549961:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788844438.549979:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.549990:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844438.549998:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eed0c68800 from 1 10000000:01000000:3.0:1788844438.550001:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788844438.550027:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.550033:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.550041:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844438.550053:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827328:0@lo:101: 00000100:00100000:3.0:1788844438.550097:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.550124:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000319ead7e going to sleep for 11 seconds 00000100:00100000:2.0:1788844438.550199:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267827328 00000100:00100000:2.0:1788844438.550205:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267827328 00000100:00100000:2.0:1788844438.550226:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788844438.550232:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9fcd1d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+10:5820:x1875739267827328:12345-0@lo:101: 00010000:00010000:2.0:1788844438.550241:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844438.550253:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a8778bf8/0x7f1093851e2d9004 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d8ffd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.550348:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8778bf8/0x7f1093851e2d9004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d8ffd expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.550358:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a8778bf8/0x7f1093851e2d9004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d8ffd expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.550365:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a8778bf8, rc 0) 00000100:00100000:2.0:1788844438.550394:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9fcd1d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:5820:x1875739267827328:12345-0@lo:101: Request processed in 162us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844438.550400:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788844438.550647:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827328:0@lo:101: 00010000:00010000:3.0:1788844438.550658:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.550666:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844438.550717:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827456:0@lo:501: 00000100:00100000:3.0:1788844438.550744:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.550918:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000319ead7e going to sleep for 11 seconds 00000100:00100000:1.0:1788844438.550971:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267827456 00000100:00100000:1.0:1788844438.550977:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267827456 00000100:00100000:0.0:1788844438.551021:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788844438.551030:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cc95919 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:5820:x1875739267827456:12345-0@lo:501: 00000100:00100000:0.0:1788844438.551867:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cc95919 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:5820:x1875739267827456:12345-0@lo:501: Request processed in 837us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844438.551875:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788844438.552038:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827456:0@lo:501: 00000100:00100000:3.0:1788844438.552076:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827584:0@lo:503: 00000100:00100000:3.0:1788844438.552116:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.552173:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000319ead7e going to sleep for 11 seconds 00000100:00100000:0.0:1788844438.552204:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267827584 00000100:00100000:0.0:1788844438.552209:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267827584 00000100:00100000:0.0:1788844438.552351:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788844438.552359:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004068b411 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:5820:x1875739267827584:12345-0@lo:503: 00000040:00080000:0.0:1788844438.552396:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788844438.552442:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004068b411 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:5820:x1875739267827584:12345-0@lo:503: Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844438.552449:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788844438.552509:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827584:0@lo:503: 00000040:00080000:3.0:1788844438.553392:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788844438.553619:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788844438.553640:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788844438.553660:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.553670:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844438.553710:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788844438.553713:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91eed0c68800 10000000:01000000:2.0:1788844438.553716:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91eed0c68800 10000000:01000000:2.0:1788844438.553720:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788844438.553734:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eed0c68800 from 1 10000000:01000000:2.0:1788844438.553736:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788844438.553778:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 000000003e0a0223/0x7f1093851e2d900b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.553786:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 000000003e0a0223/0x7f1093851e2d900b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.553795:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 000000003e0a0223/0x7f1093851e2d900b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844438.553813:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ed6673c pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827712:0@lo:101: 00000100:00100000:2.0:1788844438.553860:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844438.554073:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6400360 going to sleep for 11 seconds 00000100:00100000:1.0:1788844438.554113:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267827712 00000100:00100000:1.0:1788844438.554120:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267827712 00000100:00100000:1.0:1788844438.554153:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788844438.554160:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e640a411 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:5820:x1875739267827712:12345-0@lo:101: 00010000:00010000:1.0:1788844438.554172:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844438.554183:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f73e5a95/0x7f1093851e2d9012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d900b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844438.554205:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f73e5a95/0x7f1093851e2d9012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d900b expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844438.554214:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f73e5a95/0x7f1093851e2d9012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d900b expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844438.554222:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f73e5a95, rc 0) 00000100:00100000:1.0:1788844438.554369:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e640a411 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5820:x1875739267827712:12345-0@lo:101: Request processed in 209us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844438.554376:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788844438.554479:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ed6673c pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827712:0@lo:101: 00010000:00010000:2.0:1788844438.554492:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 000000003e0a0223/0x7f1093851e2d900b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844438.554500:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 000000003e0a0223/0x7f1093851e2d900b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844438.554764:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f857489d pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827840:0@lo:501: 00000100:00100000:0.0:1788844438.554805:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844438.554866:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010f2e755 going to sleep for 11 seconds 00000100:00100000:1.0:1788844438.554895:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267827840 00000100:00100000:1.0:1788844438.554900:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267827840 00000100:00100000:1.0:1788844438.554954:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788844438.554961:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d488161 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5820:x1875739267827840:12345-0@lo:501: 00000100:00100000:1.0:1788844438.555326:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d488161 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5820:x1875739267827840:12345-0@lo:501: Request processed in 299us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844438.555342:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788844438.555394:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f857489d pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827840:0@lo:501: 00000100:00100000:3.0:1788844438.555424:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827968:0@lo:503: 00000100:00100000:3.0:1788844438.555464:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.555575:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000000974e7c7 going to sleep for 11 seconds 00000100:00100000:0.0:1788844438.555693:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267827968 00000100:00100000:0.0:1788844438.555698:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267827968 00000100:00100000:0.0:1788844438.555722:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788844438.555728:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e04cfad0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5820:x1875739267827968:12345-0@lo:503: 00000100:00100000:0.0:1788844438.556042:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e04cfad0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5820:x1875739267827968:12345-0@lo:503: Request processed in 313us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844438.556054:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788844438.556122:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267827968:0@lo:503: 00000100:00100000:3.0:1788844438.556418:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5867:1875739267828096:0@lo:502: 00000100:00100000:3.0:1788844438.556460:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.556478:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecc41cf3 going to sleep for 11 seconds 00000100:00100000:0.0:1788844438.556516:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267828096 00000100:00100000:0.0:1788844438.556520:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267828096 00000100:00100000:0.0:1788844438.556563:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788844438.556570:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072103eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5867:x1875739267828096:12345-0@lo:502: 00000100:00100000:0.0:1788844438.556748:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072103eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5867:x1875739267828096:12345-0@lo:502: Request processed in 179us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844438.556755:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788844438.556848:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5867:1875739267828096:0@lo:502: 00000020:01000004:3.0:1788844438.556900:0:5867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788844438.556914:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000dd7c200e) 00000020:00000080:3.0:1788844438.556933:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788844438.557000:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000064781db6 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788844438.557004:0:5867:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000064781db6 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788844438.557006:0:5867:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000064781db6 4 00010000:00080000:3.0:1788844438.557033:0:5867:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000088eb9fa5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:3.0:1788844438.558668:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788844438.558871:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788844438.558900:0:5867:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788844438.558913:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7f1093851e2d9020 00000100:00080000:3.0:1788844438.558922:0:5867:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788844438.558926:0:5867:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000088eb9fa5 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1788844438.558957:0:5867:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002be94efc x1875739267828224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788844438.558974:0:5867:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788844438.560634:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875739267828224:0@lo:38: 00000100:00100000:0.0:1788844438.560709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844438.560817:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267828224 00000100:00100000:0.0:1788844438.560825:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267828224 00000100:00100000:0.0:1788844438.560857:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844438.560863:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007f3e77d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875739267828224:12345-0@lo:38: 00000100:00100000:0.0:1788844438.560914:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007f3e77d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875739267828224:12345-0@lo:38: Request processed in 51us (205us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788844438.560922:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844438.560957:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788844438.560963:0:3304:0:(import.c:65:import_set_state_nolock()) 0000000088eb9fa5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788844438.560967:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788844438.560970:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002be94efc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875739267828224:0@lo:38: 00000100:00100000:0.0:1788844438.561167:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000681954e8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5867:1875739267828352:0@lo:502: 00000100:00100000:0.0:1788844438.561205:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844438.561226:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267828352 00000100:00100000:0.0:1788844438.561230:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267828352 00000100:00100000:0.0:1788844438.561251:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788844438.561264:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002213834b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5867:x1875739267828352:12345-0@lo:502: 00000100:00100000:0.0:1788844438.561454:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002213834b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5867:x1875739267828352:12345-0@lo:502: Request processed in 191us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844438.561461:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788844438.561572:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9c01f95 going to sleep for 11 seconds 00000100:00100000:0.0:1788844438.561584:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000681954e8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5867:1875739267828352:0@lo:502: 00000040:00080000:0.0:1788844438.561604:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788844438.561853:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788844438.561874:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788844438.561893:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 000000003e0a0223/0x7f1093851e2d900b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.561903:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 000000003e0a0223/0x7f1093851e2d900b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788844438.561944:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788844438.561950:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788844438.561951:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844438.561952:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844438.561953:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844438.561955:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844438.561956:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788844438.561957:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788844438.561958:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788844438.561960:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788844438.561961:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844438.561962:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788844438.561965:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788844438.561968:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788844438.561969:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788844438.561970:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844438.561971:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844438.561972:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844438.561973:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844438.561974:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788844438.561975:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788844438.561976:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788844438.561977:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788844438.561978:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844438.561979:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788844438.561994:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788844438.562002:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d929e4cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267828480:0@lo:253: 00000100:00100000:3.0:1788844438.562032:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.562052:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ecb7dae going to sleep for 11 seconds 00000100:00100000:1.0:1788844438.562349:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267828480 00000100:00100000:1.0:1788844438.562355:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267828480 00000100:00100000:1.0:1788844438.562384:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788844438.562391:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed3e57ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5820:x1875739267828480:12345-0@lo:253: 20000000:01000000:1.0:1788844438.562412:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788844438.562430:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788844438.600963:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788844438.601019:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788844438.601138:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788844438.601144:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788844438.601166:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844438.601186:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000003d4cb36/0x7f1093851e2d8ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d8fef expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844438.601195:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844438.601232:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000003d4cb36/0x7f1093851e2d8ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d8fef expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844438.601245:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000003d4cb36/0x7f1093851e2d8ff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d8fef expref: 12 pid: 5831 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844438.601326:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1d46290 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875739267828608:0@lo:104: 00000100:00100000:1.0:1788844438.601390:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844438.601446:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f77d1b38 going to sleep for 11 seconds 00000100:00100000:0.0:1788844438.601517:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267828608 00000100:00100000:0.0:1788844438.601525:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267828608 00000100:00100000:0.0:1788844438.601606:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844438.601615:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000696994fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:5854:x1875739267828608:12345-0@lo:104: 00010000:00010000:0.0:1788844438.601788:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844438.601852:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788844438.601857:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000696994fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:5854:x1875739267828608:12345-0@lo:104: Request processed in 245us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844438.601865:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788844438.601919:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844438.601925:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.601933:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009280c5bc already unused, calling callback (000000002d6ff580) 10000000:00010000:3.0:1788844438.601936:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.601944:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844438.601965:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844438.601970:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788844438.602006:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602013:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844438.602032:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602038:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: 000000009280c5bc/0x7f1093851e2d8fef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d8ff6 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602055:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844438.602057:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844438.602059:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844438.602131:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c90f0ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267828736:0@lo:103: 00000100:00100000:3.0:1788844438.602164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844438.602236:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267828736 00000100:00100000:3.0:1788844438.602240:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267828736 00010000:00010000:3.0:1788844438.602340:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000003d4cb36/0x7f1093851e2d8ff6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d8fef expref: 13 pid: 5831 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844438.602366:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788844438.602372:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fb3a43f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:3306:x1875739267828736:12345-0@lo:103: 00010000:00010000:3.0:1788844438.602382:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844438.602386:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000003d4cb36/0x7f1093851e2d8ff6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d8fef expref: 13 pid: 5831 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602401:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000003d4cb36/0x7f1093851e2d8ff6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d8fef expref: 13 pid: 5831 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602416:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602423:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788844438.602435:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001292348s 00010000:00010000:3.0:1788844438.602439:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602445:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602450:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602455:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602459:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000e169e50 already unused, calling callback (00000000a8ab23c6) 00010000:00010000:3.0:1788844438.602462:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602468:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602474:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844438.602493:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844438.602521:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fb3a43f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:3306:x1875739267828736:12345-0@lo:103: Request processed in 150us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844438.602528:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788844438.602580:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c90f0ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267828736:0@lo:103: 00010000:00010000:1.0:1788844438.602761:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000003d4cb36/0x7f1093851e2d8ff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d8fef expref: 12 pid: 5831 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844438.602793:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1d46290 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875739267828608:0@lo:104: 00010000:00010000:1.0:1788844438.602805:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844438.602812:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844438.602817:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844438.602822:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000e169e50/0x7f1093851e2d9027 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844438.609954:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed3e57ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:5820:x1875739267828480:12345-0@lo:253: Request processed in 47556us (47915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844438.609969:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788844438.610042:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d929e4cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5820:1875739267828480:0@lo:253: 10000000:01000000:3.0:1788844438.610057:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788844438.610060:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788844438.610062:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788844438.610063:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844438.610065:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844438.610066:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844438.610067:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844438.610068:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788844438.610070:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788844438.610071:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788844438.610072:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788844438.610073:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844438.610074:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788844438.610087:0:5820:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788844438.614910:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788844438.615359:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788844438.615842:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788844438.616039:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788844438.616245:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788844438.616997:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788844438.618142:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788844438.618426:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788844438.618879:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788844438.619050:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788844438.619242:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788844438.619781:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788844438.655699:0:5820:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788844438.686132:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788844438.687669:0:5873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1788844438.689359:0:5872:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788844438.689367:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788844438.690358:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788844438.690811:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788844438.691354:0:5820:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788844438.691364:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788844438.691524:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788844438.693040:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788844438.693953:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788844438.693994:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788844438.694347:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788844438.694819:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788844438.696520:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788844438.696883:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788844438.697026:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788844438.697176:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788844438.697584:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788844438.697986:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788844438.698152:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788844438.698353:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788844438.698496:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788844438.698731:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788844438.698889:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788844438.699016:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788844438.699160:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788844438.700218:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788844438.700401:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788844438.700524:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788844438.701072:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788844438.701208:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788844438.707078:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788844438.707361:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788844438.707523:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788844438.707718:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788844438.707910:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788844438.708062:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788844438.708209:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788844438.708342:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788844438.708509:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788844438.708674:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788844438.708833:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788844438.708963:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788844438.709107:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788844438.709260:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788844438.709474:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1788844438.715067:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788844438.741181:0:5873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788844438.828499:0:5820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788844438.828850:0:5820:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4edc1dd7988 00100000:10000000:3.0:1788844438.828859:0:5820:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788844438.835899:0:5820:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788844438.835918:0:5820:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788844438.835930:0:5820:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788844438.835945:0:5820:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788844438.906989:0:5873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788844438.907084:0:5873:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788844438.907089:0:5873:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788844439.737869:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844440.763015:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844441.786931:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844442.811912:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844443.848600:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788844443.898004:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788844443.898039:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788844443.898051:0:8:0:(import.c:65:import_set_state_nolock()) 0000000088eb9fa5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788844443.898071:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000088eb9fa5 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1788844443.898105:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006c90f0ed x1875739267828992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788844443.898163:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c90f0ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875739267828992:0@lo:38: 00000100:00100000:3.0:1788844443.898273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844443.898602:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267828992 00000100:00100000:3.0:1788844443.898613:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267828992 00000100:00100000:3.0:1788844443.898659:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788844443.898679:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab51da19 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875739267828992:12345-0@lo:38: 00010000:00080000:3.0:1788844443.898713:0:5840:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:3.0:1788844443.898758:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7f1093851e2d902e 00000004:00100000:3.0:1788844443.898818:0:5840:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788844443.899005:0:5840:0:(import.c:65:import_set_state_nolock()) 0000000047fcebcc : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844443.899297:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d929e4cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267828864:0@lo:400: 10000000:01000000:2.0:1788844443.899432:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788844443.899438:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eed0c68800 from 3 10000000:01000000:2.0:1788844443.899443:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788844443.899487:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 0000000066228d67/0x7f1093851e2d9035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844443.899499:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 0000000066228d67/0x7f1093851e2d9035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844443.899524:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 0000000066228d67/0x7f1093851e2d9035 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844443.899561:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ed6673c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267829120:0@lo:101: 00000100:00100000:0.0:1788844443.901623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844443.904599:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844443.904654:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d7255c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788844443.904715:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267828864 00000100:00100000:2.0:1788844443.904728:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267828864 00000100:00100000:2.0:1788844443.904798:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267829120 00000100:00100000:2.0:1788844443.904802:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267829120 00000100:00100000:2.0:1788844443.904819:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788844443.904828:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0f5cd02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3307:x1875739267828864:12345-0@lo:400: 00000100:00100000:2.0:1788844443.904897:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0f5cd02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3307:x1875739267828864:12345-0@lo:400: Request processed in 69us (3285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844443.904905:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788844443.904935:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788844443.904940:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a0c5373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:5836:x1875739267829120:12345-0@lo:101: 00010000:00010000:2.0:1788844443.904951:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844443.904975:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5d406e1/0x7f1093851e2d903c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9035 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844443.905002:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5d406e1/0x7f1093851e2d903c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9035 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844443.905013:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5d406e1/0x7f1093851e2d903c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9035 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844443.905037:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5d406e1, rc 0) 00000100:00100000:2.0:1788844443.905063:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a0c5373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5836:x1875739267829120:12345-0@lo:101: Request processed in 123us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844443.905069:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788844443.905124:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d929e4cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267828864:0@lo:400: 00000100:00100000:2.0:1788844443.905160:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ed6673c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267829120:0@lo:101: 00010000:00010000:2.0:1788844443.905178:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 0000000066228d67/0x7f1093851e2d9035 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844443.905188:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 0000000066228d67/0x7f1093851e2d9035 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844443.905653:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ed6673c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267829248:0@lo:256: 00000100:00100000:2.0:1788844443.905718:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844443.905738:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d7255c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788844443.905752:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267829248 00000100:00100000:2.0:1788844443.905756:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267829248 00000100:00100000:2.0:1788844443.905783:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788844443.905788:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d370b60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5836:x1875739267829248:12345-0@lo:256: 20000000:01000000:2.0:1788844443.905804:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788844443.905824:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788844443.905827:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788844443.905902:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d370b60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5836:x1875739267829248:12345-0@lo:256: Request processed in 113us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844443.905910:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788844443.905940:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ed6673c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267829248:0@lo:256: 10000000:01000000:2.0:1788844443.905985:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788844443.905992:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: 0000000066228d67/0x7f1093851e2d9035 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844443.906001:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: 0000000066228d67/0x7f1093851e2d9035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844443.907088:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab51da19 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875739267828992:12345-0@lo:38: Request processed in 8412us (8807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844443.907103:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788844443.907240:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006c90f0ed x1875739267828992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788844453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788844443.907272:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788844443.907282:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788844443.907288:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788844443.907292:0:3304:0:(import.c:65:import_set_state_nolock()) 0000000088eb9fa5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788844443.907301:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c90f0ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875739267828992:0@lo:38: 00010000:00010000:3.0:1788844444.867057:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788844444.895872:0:6116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788844445.883207:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844446.906150:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844447.930235:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844448.954655:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844449.041578:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000681954e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267829376:0@lo:400: 00000100:00100000:0.0:1788844449.041689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844449.046054:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c819d22a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267829504:0@lo:400: 00000100:00100000:0.0:1788844449.046155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844449.046240:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267829376 00000100:00100000:0.0:1788844449.046252:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267829376 00000100:00100000:0.0:1788844449.046317:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788844449.046327:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8b346bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3308:x1875739267829376:12345-0@lo:400: 00000100:00100000:0.0:1788844449.046390:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8b346bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3308:x1875739267829376:12345-0@lo:400: Request processed in 64us (4703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844449.046397:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788844449.046437:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267829504 00000100:00100000:0.0:1788844449.046441:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267829504 00000100:00100000:0.0:1788844449.046470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844449.046476:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c313afc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267829504:12345-0@lo:400: 00000100:00100000:0.0:1788844449.046513:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c313afc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267829504:12345-0@lo:400: Request processed in 37us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844449.046519:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844449.046594:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000681954e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267829376:0@lo:400: 00010000:00080000:0.0:1788844449.046636:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c819d22a x1875739267829504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844449.046667:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c819d22a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267829504:0@lo:400: 00010000:00010000:2.0:1788844449.979816:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844451.001691:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788844451.676026:0:6319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccf074470 20000000:00000080:2.0:1788844451.676054:0:6319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eef4d49400 uarg=0000000000000000 20000000:01000000:2.0:1788844451.676103:0:6319:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788844451.676112:0:6319:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788844451.676118:0:6319:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788844451.677031:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788844451.677049:0:6319:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788844451.681270:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788844451.682674:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788844451.682764:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788844451.682832:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788844451.682871:0:6319:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788844451.682894:0:6319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844451.682921:0:6319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a8778bf8/0x7f1093851e2d9004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d8ffd expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844451.682930:0:6319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844451.682983:0:6319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a8778bf8/0x7f1093851e2d9004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d8ffd expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844451.683002:0:6319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a8778bf8/0x7f1093851e2d9004 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d8ffd expref: 11 pid: 5831 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844451.683084:0:6319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ed6673c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1875739267829632:0@lo:104: 00000100:00100000:2.0:1788844451.683177:0:6319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844451.683375:0:6319:0:(client.c:2715:ptlrpc_set_wait()) set 0000000062a362d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788844451.683524:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267829632 00000100:00100000:0.0:1788844451.683651:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267829632 00000100:00100000:0.0:1788844451.683752:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788844451.683763:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007477420 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:6319:x1875739267829632:12345-0@lo:104: 00010000:00010000:0.0:1788844451.683779:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844451.683863:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788844451.683869:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007477420 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:6319:x1875739267829632:12345-0@lo:104: Request processed in 109us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844451.683877:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788844451.683941:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844451.683949:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.683958:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b0c900de already unused, calling callback (000000002d6ff580) 10000000:00010000:3.0:1788844451.683962:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.683989:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844451.683997:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844451.684003:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788844451.684053:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.684060:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844451.684082:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.684090:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: 00000000b0c900de/0x7f1093851e2d8ffd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9004 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.684111:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844451.684113:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844451.684114:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844451.684201:0:6319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ed6673c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1875739267829632:0@lo:104: 00010000:00010000:1.0:1788844451.684227:0:6319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844451.684411:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fe0522f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267829760:0@lo:103: 00000100:00100000:0.0:1788844451.684531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844451.684827:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267829760 00000100:00100000:3.0:1788844451.684834:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267829760 00010000:00010000:3.0:1788844451.684859:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a8778bf8/0x7f1093851e2d9004 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d8ffd expref: 12 pid: 5831 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844451.684929:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788844451.684937:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c819d22a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3306:x1875739267829760:12345-0@lo:103: 00010000:00010000:3.0:1788844451.684952:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844451.684957:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a8778bf8/0x7f1093851e2d9004 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d8ffd expref: 12 pid: 5831 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.684977:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a8778bf8/0x7f1093851e2d9004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d8ffd expref: 12 pid: 5831 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.684994:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a8778bf8/0x7f1093851e2d9004 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d8ffd expref: 12 pid: 5831 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.685068:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.685077:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.685093:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.685101:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.685107:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.685113:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.685119:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c1971d7a already unused, calling callback (00000000a8ab23c6) 00010000:00010000:3.0:1788844451.685122:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.685129:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844451.685272:0:6319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844451.685280:0:6319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.686839:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.686860:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c1971d7a/0x7f1093851e2d9043 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844451.686881:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844451.686984:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c819d22a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:3306:x1875739267829760:12345-0@lo:103: Request processed in 2044us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844451.686996:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788844451.687118:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fe0522f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267829760:0@lo:103: 00010000:00010000:0.0:1788844452.026712:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788844452.743071:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788844452.743083:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eed0c68800 from 1 10000000:01000000:0.0:1788844452.743089:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788844452.743149:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: 0000000041f9864f/0x7f1093851e2d904a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844452.743163:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: 0000000041f9864f/0x7f1093851e2d904a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844452.743173:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: 0000000041f9864f/0x7f1093851e2d904a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844452.743211:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000681954e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267829888:0@lo:101: 00000100:00100000:0.0:1788844452.743283:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844452.743342:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000445d7023 going to sleep for 11 seconds 00000100:00100000:3.0:1788844452.743456:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267829888 00000100:00100000:3.0:1788844452.743465:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267829888 00000100:00100000:3.0:1788844452.743554:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788844452.743564:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a174e21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:5836:x1875739267829888:12345-0@lo:101: 00010000:00010000:3.0:1788844452.743578:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844452.743593:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b0c900de/0x7f1093851e2d9051 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d904a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844452.743616:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b0c900de/0x7f1093851e2d9051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d904a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844452.743626:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b0c900de/0x7f1093851e2d9051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d904a expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844452.743634:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b0c900de, rc 0) 00000100:00100000:3.0:1788844452.743674:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a174e21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5836:x1875739267829888:12345-0@lo:101: Request processed in 112us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844452.743680:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788844452.743808:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000681954e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267829888:0@lo:101: 00010000:00010000:0.0:1788844452.743824:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: 0000000041f9864f/0x7f1093851e2d904a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844452.743832:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: 0000000041f9864f/0x7f1093851e2d904a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844452.743886:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000681954e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267830016:0@lo:501: 00000100:00100000:0.0:1788844452.743914:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844452.743938:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000445d7023 going to sleep for 11 seconds 00000100:00100000:3.0:1788844452.747422:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267830016 00000100:00100000:3.0:1788844452.747439:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267830016 00000100:00100000:3.0:1788844452.747522:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788844452.747531:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000898a32c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5836:x1875739267830016:12345-0@lo:501: 00000100:00100000:3.0:1788844452.747866:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000898a32c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5836:x1875739267830016:12345-0@lo:501: Request processed in 336us (3951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844452.747874:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788844452.747928:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000681954e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267830016:0@lo:501: 00000100:00100000:3.0:1788844452.747995:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000900e69a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267830144:0@lo:503: 00000100:00100000:3.0:1788844452.748039:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844452.748064:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267830144 00000100:00100000:3.0:1788844452.748069:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267830144 00000100:00100000:0.0:1788844452.748173:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788844452.748181:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041de74be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5836:x1875739267830144:12345-0@lo:503: 00000100:00100000:0.0:1788844452.748301:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041de74be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5836:x1875739267830144:12345-0@lo:503: Request processed in 122us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844452.748309:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788844452.754652:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012580f30 going to sleep for 11 seconds 00000100:00100000:0.0:1788844452.754701:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000900e69a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267830144:0@lo:503: 00000100:00100000:0.0:1788844452.758658:0:6346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007eb3527 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6346:1875739267830272:0@lo:502: 00000100:00100000:0.0:1788844452.758741:0:6346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844452.758779:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267830272 00000100:00100000:0.0:1788844452.758785:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267830272 00000100:00100000:0.0:1788844452.758822:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788844452.758836:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d04f7a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6346:x1875739267830272:12345-0@lo:502: 00000100:00100000:0.0:1788844452.759029:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d04f7a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6346:x1875739267830272:12345-0@lo:502: Request processed in 193us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844452.759037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788844452.759085:0:6346:0:(client.c:2715:ptlrpc_set_wait()) set 000000009440f0af going to sleep for 11 seconds 00000100:00100000:0.0:1788844452.759106:0:6346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007eb3527 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6346:1875739267830272:0@lo:502: 00000020:01000000:0.0:1788844452.759134:0:6346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788844452.759143:0:6346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844452.759145:0:6346:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788844452.759151:0:6346:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eed0c68800 00000020:00000080:0.0:1788844452.759153:0:6346:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788844452.759189:0:6346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6346:1875739267830400:0@lo:502: 00000100:00100000:0.0:1788844452.759231:0:6346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844452.759251:0:6346:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1d22300 going to sleep for 11 seconds 00000100:00100000:3.0:1788844452.759450:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267830400 00000100:00100000:3.0:1788844452.759456:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267830400 00000100:00100000:3.0:1788844452.759490:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788844452.759506:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6346:x1875739267830400:12345-0@lo:502: 00000100:00100000:3.0:1788844452.759645:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6346:x1875739267830400:12345-0@lo:502: Request processed in 148us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844452.759652:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788844452.759730:0:6346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6346:1875739267830400:0@lo:502: 00000020:01000000:0.0:1788844452.759748:0:6346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788844452.759753:0:6346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844452.759754:0:6346:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788844452.759757:0:6346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788844452.759811:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788844452.759826:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788844452.759837:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5526c00/0x7f1093851e2d904a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844452.759848:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec5526c00/0x7f1093851e2d904a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844453.050854:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844454.077366:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844454.140254:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267830528:0@lo:400: 00000100:00100000:2.0:1788844454.140327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844454.140389:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844454.140395:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267830656:0@lo:400: 00000100:00100000:2.0:1788844454.140424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844454.140478:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267830656 00000100:00100000:2.0:1788844454.140485:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267830656 00000100:00100000:1.0:1788844454.140518:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267830528 00000100:00100000:1.0:1788844454.140525:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267830528 00000100:00100000:2.0:1788844454.140571:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788844454.140581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788844454.140586:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267830656:12345-0@lo:400: 00000100:00100000:1.0:1788844454.140596:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3307:x1875739267830528:12345-0@lo:400: 00000100:00100000:1.0:1788844454.140654:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3307:x1875739267830528:12345-0@lo:400: Request processed in 63us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844454.140662:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788844454.147045:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267830656:12345-0@lo:400: Request processed in 6455us (6610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844454.147071:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788844454.150724:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eefb6d5500 x1875739267830656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844454.150744:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267830656:0@lo:400: 00000100:00100000:2.0:1788844454.157021:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267830528:0@lo:400: 00010000:00010000:2.0:1788844455.102683:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844456.132099:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844457.145782:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844458.172465:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844459.193971:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844459.258460:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267830912:0@lo:400: 00000100:00100000:3.0:1788844459.258586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844459.258643:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788844459.258649:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267830784:0@lo:400: 00000100:00100000:3.0:1788844459.258688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844459.258717:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267830912 00000100:00100000:3.0:1788844459.258724:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267830912 00000100:00100000:3.0:1788844459.258779:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788844459.258788:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267830912:12345-0@lo:400: 00000100:00100000:3.0:1788844459.258834:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267830912:12345-0@lo:400: Request processed in 47us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844459.258841:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788844459.258872:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267830784 00000100:00100000:3.0:1788844459.258875:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267830784 00000100:00100000:3.0:1788844459.258897:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788844459.258903:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3306:x1875739267830784:12345-0@lo:400: 00000100:00100000:3.0:1788844459.258928:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3306:x1875739267830784:12345-0@lo:400: Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844459.258934:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788844459.258978:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267830784:0@lo:400: 00010000:00080000:3.0:1788844459.258992:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eed856ad80 x1875739267830912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844459.259004:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267830912:0@lo:400: 00000020:01000004:3.0:1788844460.126624:0:6682:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788844460.126629:0:6682:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788844460.126922:0:6682:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91eef3110000 00000020:01000004:3.0:1788844460.126937:0:6682:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788844460.126949:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788844460.126962:0:6682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91ef01bf4d28) 00000020:00000080:3.0:1788844460.126976:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788844460.143108:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788844460.143382:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788844460.177796:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788844460.184063:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788844460.184101:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788844460.184160:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788844460.184188:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788844460.188599:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788844460.188615:0:6682:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788844460.188627:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7f1093851e2d905f 00000020:01000004:3.0:1788844460.188637:0:6682:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788844460.188658:0:6682:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788844460.188662:0:6682:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788844460.188668:0:6682:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788844460.188672:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788844460.188833:0:6682:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91eec2de8000) 00000020:00000080:3.0:1788844460.188925:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788844460.193228:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788844460.193488:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788844460.193495:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788844460.200189:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788844460.200200:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788844460.200817:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788844460.200824:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788844460.207189:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788844460.207420:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788844460.207426:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788844460.209248:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788844460.209312:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1788844460.223383:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844460.245025:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788844460.245394:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788844460.245401:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788844460.249098:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788844460.249114:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788844460.250813:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788844460.250826:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788844460.256532:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788844460.257089:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788844460.257095:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788844460.258140:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788844460.258151:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788844460.379133:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788844460.380513:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788844460.380523:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788844460.396033:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788844460.396050:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788844460.397269:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788844460.397293:0:6682:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788844460.397300:0:6682:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788844460.442521:0:6682:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788844460.442667:0:6682:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.143@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788844460.442670:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788844460.442672:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788844460.442674:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844460.442675:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844460.442676:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844460.442678:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844460.442679:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788844460.442684:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788844460.442685:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788844460.442687:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844460.442688:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788844460.442691:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788844460.442693:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788844460.442694:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788844460.442695:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844460.442696:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844460.442697:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844460.442698:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844460.442699:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788844460.442700:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788844460.442701:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788844460.442702:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844460.442703:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788844460.442728:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788844460.442744:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267831040:0@lo:253: 00000100:00100000:3.0:1788844460.442813:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.443030:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec3366480 going to sleep for 11 seconds 00000100:00100000:0.0:1788844460.445323:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267831040 00000100:00100000:0.0:1788844460.445337:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267831040 00000100:00100000:0.0:1788844460.445512:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788844460.445524:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267831040:12345-0@lo:253: 20000000:01000000:0.0:1788844460.445596:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788844460.445600:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788844460.445606:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788844460.445609:0:5831:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788844460.447635:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788844460.448368:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788844460.448387:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788844460.448446:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788844460.448455:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788844460.448485:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788844460.448573:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788844460.449236:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788844460.449260:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.143@tcp 20000000:01000000:0.0:1788844460.449262:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.143@tcp (null) (null) (null) 00000040:00080000:0.0:1788844460.449295:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788844460.449303:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788844460.449404:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788844460.449429:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.143@tcp (null) (null) 00000040:00080000:0.0:1788844460.449467:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788844460.449478:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788844460.449507:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788844460.449595:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788844460.451055:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788844460.451078:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.143@tcp 20000000:01000000:0.0:1788844460.451080:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.143@tcp (null) (null) (null) 00000040:00080000:0.0:1788844460.451110:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788844460.451117:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788844460.451140:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788844460.451147:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.143@tcp (null) (null) 00000040:00080000:0.0:1788844460.451269:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788844460.451279:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788844460.451307:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788844460.451335:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788844460.451372:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788844460.451375:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788844460.451378:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788844460.451392:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788844460.451395:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788844460.451426:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788844460.451428:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788844460.452261:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788844460.452313:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788844460.452378:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788844460.453112:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788844460.453153:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788844460.453214:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788844460.453226:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788844460.453229:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788844460.454041:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788844460.454100:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788844460.454155:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788844460.454444:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788844460.454498:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788844460.454605:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788844460.454620:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788844460.454623:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788844460.455119:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788844460.456116:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788844460.456175:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788844460.456245:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788844460.456264:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788844460.456266:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788844460.456276:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788844460.456297:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.456315:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5527400/0x7f1093851e2d8f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d8f7f expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.456322:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d8fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d8f9b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.456328:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed99bbc00/0x7f1093851e2d9012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d900b expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.456335:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.456386:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed99bbc00/0x7f1093851e2d9012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d900b expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.456401:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eed99bbc00/0x7f1093851e2d9012 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d900b expref: 12 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844460.456416:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aed880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267831168:0@lo:104: 00000100:00100000:0.0:1788844460.456496:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788844460.456584:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d8fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d8f9b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.456593:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d8fa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d8f9b expref: 12 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844460.456601:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267831296:0@lo:104: 00000100:00100000:0.0:1788844460.456623:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788844460.456648:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5527400/0x7f1093851e2d8f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d8f7f expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.456656:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5527400/0x7f1093851e2d8f86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d8f7f expref: 12 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844460.456664:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aeca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267831424:0@lo:104: 00000100:00100000:0.0:1788844460.456685:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844460.456696:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59ca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844460.456789:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267831168 00000100:00100000:1.0:1788844460.456798:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267831168 00000100:00100000:1.0:1788844460.456846:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267831296 00000100:00100000:1.0:1788844460.456850:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267831296 00000100:00100000:1.0:1788844460.456876:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267831424 00000100:00100000:1.0:1788844460.456879:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267831424 00000100:00100000:1.0:1788844460.456891:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788844460.456900:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:5831:x1875739267831168:12345-0@lo:104: 00010000:00010000:1.0:1788844460.456911:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d900b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.456994:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788844460.457001:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:5831:x1875739267831168:12345-0@lo:104: Request processed in 102us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.457008:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788844460.457028:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788844460.457035:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:5831:x1875739267831296:12345-0@lo:104: 00010000:00010000:1.0:1788844460.457042:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec0025e00/0x7f1093851e2d8f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457072:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788844460.457077:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:5831:x1875739267831296:12345-0@lo:104: Request processed in 44us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.457083:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788844460.457094:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788844460.457100:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:5831:x1875739267831424:12345-0@lo:104: 00010000:00010000:1.0:1788844460.457107:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2d8f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457132:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788844460.457136:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:5831:x1875739267831424:12345-0@lo:104: Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.457142:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788844460.457158:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788844460.457164:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d900b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457172:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205ce00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844460.457182:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d900b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457191:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d900b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844460.457198:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d900b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844460.457204:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788844460.457235:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d900b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457241:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788844460.457261:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d900b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457268:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d900b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9012 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457283:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788844460.457286:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0025e00/0x7f1093851e2d8f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457291:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025e00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844460.457295:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0025e00/0x7f1093851e2d8f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457302:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0025e00/0x7f1093851e2d8f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844460.457318:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0025e00/0x7f1093851e2d8f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844460.457323:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788844460.457336:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0025e00/0x7f1093851e2d8f9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457342:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788844460.457362:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0025e00/0x7f1093851e2d8f9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457369:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0025e00/0x7f1093851e2d8f9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d8fa2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457380:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844460.457383:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2d8f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457388:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844460.457391:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2d8f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457398:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2d8f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844460.457404:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2d8f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844460.457409:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788844460.457429:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2d8f7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457436:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788844460.457452:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2d8f7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457458:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2d8f7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d8f86 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457472:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844460.457474:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844460.457475:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844460.457482:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844460.457500:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267831552:0@lo:103: 00000100:00100000:1.0:1788844460.457532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844460.457596:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788844460.457602:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267831680:0@lo:103: 00000100:00100000:1.0:1788844460.457623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844460.457654:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267831808:0@lo:103: 00000100:00100000:1.0:1788844460.457676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844460.457712:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267831552 00000100:00100000:1.0:1788844460.457717:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267831552 00010000:00010000:1.0:1788844460.457737:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed99bbc00/0x7f1093851e2d9012 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d900b expref: 13 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844460.457752:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267831680 00000100:00100000:1.0:1788844460.457755:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267831680 00010000:00010000:1.0:1788844460.457763:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d8fa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d8f9b expref: 14 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844460.457785:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267831808 00000100:00100000:1.0:1788844460.457788:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267831808 00010000:00010000:1.0:1788844460.457800:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5527400/0x7f1093851e2d8f86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d8f7f expref: 15 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844460.457811:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788844460.457815:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:3307:x1875739267831552:12345-0@lo:103: 00010000:00010000:1.0:1788844460.457825:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844460.457830:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed99bbc00/0x7f1093851e2d9012 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d900b expref: 15 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457839:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed99bbc00/0x7f1093851e2d9012 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d900b expref: 15 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457855:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844460.457884:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:3307:x1875739267831552:12345-0@lo:103: Request processed in 68us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.457890:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788844460.457903:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788844460.457909:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:3307:x1875739267831680:12345-0@lo:103: 00010000:00010000:1.0:1788844460.457916:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844460.457920:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d8fa2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d8f9b expref: 14 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457927:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d8fa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d8f9b expref: 14 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.457935:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844460.457963:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:3307:x1875739267831680:12345-0@lo:103: Request processed in 55us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.457969:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788844460.457980:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788844460.457987:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:3305:x1875739267831808:12345-0@lo:103: 00010000:00010000:1.0:1788844460.457993:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844460.457998:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5527400/0x7f1093851e2d8f86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d8f7f expref: 13 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458006:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5527400/0x7f1093851e2d8f86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d8f7f expref: 13 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458017:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458025:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458037:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458044:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458050:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458056:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458061:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526a00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844460.458074:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458082:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458091:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.458100:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844460.458129:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:3305:x1875739267831808:12345-0@lo:103: Request processed in 142us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.458135:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788844460.458173:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267831808:0@lo:103: 00000100:00100000:1.0:1788844460.458198:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267831680:0@lo:103: 00000100:00100000:1.0:1788844460.458205:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267831552:0@lo:103: 00010000:00010000:0.0:1788844460.458444:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bbc00/0x7f1093851e2d9012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d900b expref: 12 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844460.458454:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aed880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267831168:0@lo:104: 00010000:00010000:0.0:1788844460.458464:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d8fa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d8f9b expref: 11 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844460.458473:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267831296:0@lo:104: 00010000:00010000:0.0:1788844460.458482:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5527400/0x7f1093851e2d8f86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d8f7f expref: 10 pid: 5833 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844460.458489:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aeca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267831424:0@lo:104: 00010000:00010000:0.0:1788844460.458511:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.458520:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.458526:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.458532:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d906d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788844460.458568:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788844460.501131:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:6682:x1875739267831040:12345-0@lo:253: Request processed in 55599us (58307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844460.501146:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788844460.501239:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267831040:0@lo:253: 10000000:01000000:3.0:1788844460.501255:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788844460.501258:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788844460.501260:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788844460.501262:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844460.501263:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788844460.501265:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844460.501266:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844460.501267:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788844460.501269:0:6682:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788844460.501270:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844460.501272:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788844460.501292:0:6682:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91eef3110000 from lustre-OST0000 10000000:01000000:3.0:1788844460.501317:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788844460.501328:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788844460.501336:0:6682:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91eed850cd28 local copy 10000000:01000000:3.0:1788844460.501340:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788844460.501387:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.501398:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.501408:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844460.501427:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267831936:0@lo:101: 00000100:00100000:3.0:1788844460.501465:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.501591:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec3366a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788844460.501702:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267831936 00000100:00100000:1.0:1788844460.501709:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267831936 00000100:00100000:1.0:1788844460.501791:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788844460.501801:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:6682:x1875739267831936:12345-0@lo:101: 00010000:00010000:1.0:1788844460.501813:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844460.501826:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d907b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9074 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.501864:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d907b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9074 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.501875:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d907b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9074 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.501892:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99ba800, rc 0) 00000100:00100000:1.0:1788844460.501974:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+10:6682:x1875739267831936:12345-0@lo:101: Request processed in 174us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.501981:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788844460.502038:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267831936:0@lo:101: 00010000:00010000:3.0:1788844460.502051:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.502060:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844460.502165:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832064:0@lo:501: 00000100:00100000:3.0:1788844460.502191:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.502252:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec3366a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844460.502289:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267832064 00000100:00100000:0.0:1788844460.502293:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267832064 00000100:00100000:0.0:1788844460.502325:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788844460.502332:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+10:6682:x1875739267832064:12345-0@lo:501: 00000100:00100000:0.0:1788844460.502608:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+10:6682:x1875739267832064:12345-0@lo:501: Request processed in 276us (415us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788844460.502615:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788844460.502700:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832064:0@lo:501: 10000000:01000000:3.0:1788844460.502713:0:6682:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788844460.502736:0:6682:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788844460.502742:0:6682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.502757:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.502764:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.502786:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788844460.502815:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91eef3110000 10000000:01000000:3.0:1788844460.502820:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788844460.502823:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1788844460.502825:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91eed850cd28 10000000:01000000:3.0:1788844460.502827:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788844460.502830:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844460.502831:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91eed850cd28 from 1 00010000:00010000:1.0:1788844460.502838:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024200 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844460.502841:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844460.502842:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788844460.502850:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844460.502857:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.502859:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2d9082 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844460.502863:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788844460.502866:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2d9082 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.502874:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2d9082 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.502880:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844460.502885:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832192:0@lo:101: 00010000:00010000:1.0:1788844460.502885:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788844460.502911:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844460.502942:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267832320:0@lo:103: 00000100:00100000:2.0:1788844460.502973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788844460.503032:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.503041:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0024200/0x7f1093851e2d9074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7f1093851e2d907b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.503066:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844460.503068:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844460.503070:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844460.503151:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267832320 00000100:00100000:0.0:1788844460.503155:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267832320 00000100:00100000:3.0:1788844460.503157:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844460.503224:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844460.503232:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+10:3306:x1875739267832320:12345-0@lo:103: 00010000:00010000:0.0:1788844460.503243:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844460.503256:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d907b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d9074 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.503280:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844460.503359:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:3306:x1875739267832320:12345-0@lo:103: Request processed in 128us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844460.503366:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844460.503384:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267832192 00000100:00100000:0.0:1788844460.503388:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267832192 00000100:00100000:0.0:1788844460.503415:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788844460.503422:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:6682:x1875739267832192:12345-0@lo:101: 00010000:00010000:0.0:1788844460.503430:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844460.503441:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d9089 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9082 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.503456:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d9089 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9082 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.503465:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d9089 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9082 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.503471:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526a00, rc 0) 00000100:00100000:0.0:1788844460.503506:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+10:6682:x1875739267832192:12345-0@lo:101: Request processed in 84us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844460.503512:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788844460.503622:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832192:0@lo:101: 00010000:00010000:3.0:1788844460.503633:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2d9082 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9089 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.503655:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2d9082 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9089 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844460.503674:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:2.0:1788844460.503682:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267832320:0@lo:103: 00010000:00010000:3.0:1788844460.503691:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2d9082 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9089 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.503698:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2d9082 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9089 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844460.503705:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788844460.503709:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788844460.503713:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788844460.503716:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788844460.503731:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.503738:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.503746:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844460.503757:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832448:0@lo:101: 00000100:00100000:3.0:1788844460.503780:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.503805:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844460.503863:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267832448 00000100:00100000:2.0:1788844460.503867:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267832448 00000100:00100000:0.0:1788844460.503917:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788844460.503924:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+10:6682:x1875739267832448:12345-0@lo:101: 00010000:00010000:0.0:1788844460.503932:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844460.503940:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9090 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.503963:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9090 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.503972:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9090 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.503978:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527400, rc 0) 00000100:00100000:0.0:1788844460.504046:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:6682:x1875739267832448:12345-0@lo:101: Request processed in 121us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844460.504055:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788844460.504125:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832448:0@lo:101: 00010000:00010000:3.0:1788844460.504136:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.504148:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844460.504220:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832576:0@lo:501: 00000100:00100000:3.0:1788844460.504244:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.504265:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844460.504279:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267832576 00000100:00100000:1.0:1788844460.504284:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267832576 00000100:00100000:1.0:1788844460.504312:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788844460.504323:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:6682:x1875739267832576:12345-0@lo:501: 00000100:00100000:1.0:1788844460.504598:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:6682:x1875739267832576:12345-0@lo:501: Request processed in 275us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.504605:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788844460.504673:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832576:0@lo:501: 00000100:00100000:3.0:1788844460.504698:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832704:0@lo:503: 00000100:00100000:3.0:1788844460.504735:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.504802:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844460.504865:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267832704 00000100:00100000:0.0:1788844460.504870:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267832704 00000100:00100000:0.0:1788844460.504901:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788844460.504907:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:6682:x1875739267832704:12345-0@lo:503: 00000100:00100000:0.0:1788844460.505814:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:6682:x1875739267832704:12345-0@lo:503: Request processed in 903us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844460.505823:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788844460.506747:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832704:0@lo:503: 00000040:00080000:3.0:1788844460.507367:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788844460.507690:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832832:0@lo:502: 00000100:00100000:3.0:1788844460.507763:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.507797:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844460.507907:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267832832 00000100:00100000:1.0:1788844460.507914:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267832832 00000100:00100000:1.0:1788844460.508003:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788844460.508013:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:6682:x1875739267832832:12345-0@lo:502: 00000100:00100000:1.0:1788844460.508239:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:6682:x1875739267832832:12345-0@lo:502: Request processed in 226us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.508246:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788844460.508732:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832832:0@lo:502: 00000040:00080000:3.0:1788844460.509032:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788844460.509095:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788844460.509127:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788844460.509182:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788844460.509219:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788844460.509247:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788844460.509274:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832960:0@lo:502: 00000100:00100000:3.0:1788844460.509315:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.510126:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844460.510362:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267832960 00000100:00100000:0.0:1788844460.510370:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267832960 00000100:00100000:0.0:1788844460.510526:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788844460.510650:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:6682:x1875739267832960:12345-0@lo:502: 00000100:00100000:0.0:1788844460.511030:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:6682:x1875739267832960:12345-0@lo:502: Request processed in 494us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844460.511039:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788844460.511260:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267832960:0@lo:502: 00000040:00080000:2.0:1788844460.512741:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788844460.512757:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788844460.515298:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788844460.515310:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788844460.515318:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844460.515320:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788844460.515325:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788844460.515369:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91eeff3ecd28) 00000020:00000080:2.0:1788844460.515392:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788844460.515400:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788844460.515512:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eef3110000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788844460.515520:0:6702:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788844460.515529:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7f1093851e2d90a5 00010000:00010000:3.0:1788844460.521951:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788844460.522319:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788844460.525469:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788844460.525814:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788844460.535125:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788844460.535724:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788844460.542583:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788844460.542599:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788844460.542607:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844460.542609:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788844460.542613:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788844460.542618:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844460.542619:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788844460.542622:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788844460.542624:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788844460.542686:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788844460.542690:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844460.542691:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788844460.542695:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788844460.544526:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788844460.544590:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788844460.544611:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.544631:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844460.544640:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eef3110000 from 1 10000000:01000000:0.0:1788844460.544643:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788844460.544683:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.544691:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.544702:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844460.544725:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833088:0@lo:101: 00000100:00100000:0.0:1788844460.544790:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844460.544836:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4fb3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788844460.547766:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267833088 00000100:00100000:1.0:1788844460.547782:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267833088 00000100:00100000:1.0:1788844460.547840:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788844460.547851:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:6682:x1875739267833088:12345-0@lo:101: 00010000:00010000:1.0:1788844460.547869:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844460.547887:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bb800/0x7f1093851e2d90b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d90ac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.547916:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bb800/0x7f1093851e2d90b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d90ac expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.547938:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bb800/0x7f1093851e2d90b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d90ac expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.547948:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bb800, rc 0) 00000100:00100000:1.0:1788844460.548030:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267833088:12345-0@lo:101: Request processed in 181us (3239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.548037:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788844460.548474:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833088:0@lo:101: 00010000:00010000:3.0:1788844460.548493:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.548503:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844460.548674:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833216:0@lo:501: 00000100:00100000:3.0:1788844460.548708:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.548740:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec3366540 going to sleep for 11 seconds 00000100:00100000:1.0:1788844460.549114:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267833216 00000100:00100000:1.0:1788844460.549120:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267833216 00000100:00100000:1.0:1788844460.549155:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788844460.549163:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267833216:12345-0@lo:501: 00000100:00100000:1.0:1788844460.549406:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267833216:12345-0@lo:501: Request processed in 243us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.549414:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788844460.550103:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833216:0@lo:501: 00000100:00100000:3.0:1788844460.550143:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833344:0@lo:503: 00000100:00100000:3.0:1788844460.550190:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.550212:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec3366540 going to sleep for 11 seconds 00000100:00100000:0.0:1788844460.550272:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267833344 00000100:00100000:0.0:1788844460.550278:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267833344 00000100:00100000:0.0:1788844460.550308:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788844460.550316:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267833344:12345-0@lo:503: 00000100:00100000:0.0:1788844460.550624:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267833344:12345-0@lo:503: Request processed in 307us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844460.550631:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788844460.550938:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833344:0@lo:503: 00000040:00080000:3.0:1788844460.551223:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788844460.551287:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833472:0@lo:502: 00000100:00100000:3.0:1788844460.551327:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.551361:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec3366540 going to sleep for 11 seconds 00000100:00100000:1.0:1788844460.551436:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267833472 00000100:00100000:1.0:1788844460.551441:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267833472 00000100:00100000:1.0:1788844460.551480:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788844460.551487:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267833472:12345-0@lo:502: 00000100:00100000:1.0:1788844460.551673:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267833472:12345-0@lo:502: Request processed in 186us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.551693:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788844460.554094:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833472:0@lo:502: 00000040:00080000:3.0:1788844460.554439:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788844460.554508:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788844460.554580:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833600:0@lo:502: 00000100:00100000:3.0:1788844460.554649:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.554690:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec3366540 going to sleep for 11 seconds 00000100:00100000:2.0:1788844460.557948:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267833600 00000100:00100000:2.0:1788844460.557961:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267833600 00000100:00100000:2.0:1788844460.558013:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788844460.558023:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267833600:12345-0@lo:502: 00000100:00100000:2.0:1788844460.558287:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267833600:12345-0@lo:502: Request processed in 265us (3637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844460.558294:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788844460.558450:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833600:0@lo:502: 00000040:00080000:3.0:1788844460.558648:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788844460.558664:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788844460.559262:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844460.559272:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844460.559274:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788844460.559279:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eef3110000 00000020:00000080:3.0:1788844460.559281:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788844460.559299:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844460.559302:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844460.559304:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788844460.559306:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788844460.559429:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788844460.559448:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788844460.559466:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.559493:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844460.559570:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788844460.559574:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91eef3110000 10000000:01000000:0.0:1788844460.559576:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91eef3110000 10000000:01000000:0.0:1788844460.559581:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788844460.559587:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eef3110000 from 1 10000000:01000000:0.0:1788844460.559589:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788844460.559624:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.559631:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.559641:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844460.559662:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833728:0@lo:101: 00000100:00100000:0.0:1788844460.559822:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844460.559862:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed06d6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788844460.559910:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267833728 00000100:00100000:1.0:1788844460.559916:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267833728 00000100:00100000:1.0:1788844460.559954:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788844460.559963:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267833728:12345-0@lo:101: 00010000:00010000:1.0:1788844460.559974:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844460.559994:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99ba000/0x7f1093851e2d90c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d90ba expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.560017:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99ba000/0x7f1093851e2d90c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d90ba expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.560029:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99ba000/0x7f1093851e2d90c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d90ba expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.560038:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99ba000, rc 0) 00000100:00100000:1.0:1788844460.560081:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:6682:x1875739267833728:12345-0@lo:101: Request processed in 119us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.560086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788844460.560253:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833728:0@lo:101: 00010000:00010000:0.0:1788844460.560267:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844460.560277:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844460.560379:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833856:0@lo:501: 00000100:00100000:0.0:1788844460.560405:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844460.560431:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed06d6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788844460.560479:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267833856 00000100:00100000:1.0:1788844460.560483:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267833856 00000100:00100000:1.0:1788844460.560513:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788844460.560520:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:6682:x1875739267833856:12345-0@lo:501: 00000100:00100000:1.0:1788844460.560811:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:6682:x1875739267833856:12345-0@lo:501: Request processed in 290us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.560817:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788844460.561223:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833856:0@lo:501: 00000100:00100000:0.0:1788844460.561256:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833984:0@lo:503: 00000100:00100000:0.0:1788844460.561302:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844460.561338:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed06d6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788844460.561406:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267833984 00000100:00100000:2.0:1788844460.561411:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267833984 00000100:00100000:2.0:1788844460.561447:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788844460.561455:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:6682:x1875739267833984:12345-0@lo:503: 00000100:00100000:2.0:1788844460.561934:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:6682:x1875739267833984:12345-0@lo:503: Request processed in 478us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844460.561942:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788844460.562026:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267833984:0@lo:503: 00000040:00080000:0.0:1788844460.562365:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788844460.562441:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267834112:0@lo:502: 00000100:00100000:0.0:1788844460.562479:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844460.562584:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed06d6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788844460.563193:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267834112 00000100:00100000:3.0:1788844460.563201:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267834112 00000100:00100000:3.0:1788844460.563273:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788844460.563283:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:6682:x1875739267834112:12345-0@lo:502: 00000100:00100000:3.0:1788844460.563561:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:6682:x1875739267834112:12345-0@lo:502: Request processed in 254us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844460.563569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788844460.563831:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267834112:0@lo:502: 00000040:00080000:0.0:1788844460.564110:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788844460.564161:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788844460.564196:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788844460.564264:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788844460.564303:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788844460.564574:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788844460.564615:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788844460.564649:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788844460.565400:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788844460.565452:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788844460.565488:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788844460.566812:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788844460.566925:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788844460.566975:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788844460.567039:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788844460.567072:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788844460.567103:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788844460.567146:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788844460.567177:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788844460.567211:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788844460.567260:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788844460.567297:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788844460.567328:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788844460.567384:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788844460.567418:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788844460.567453:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788844460.567501:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788844460.567562:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788844460.567612:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267834240:0@lo:502: 00000100:00100000:0.0:1788844460.568309:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844460.568411:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed06d6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788844460.568824:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267834240 00000100:00100000:3.0:1788844460.568832:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267834240 00000100:00100000:0.0:1788844460.569043:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788844460.569053:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:6682:x1875739267834240:12345-0@lo:502: 00000100:00100000:0.0:1788844460.569379:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:6682:x1875739267834240:12345-0@lo:502: Request processed in 327us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844460.569386:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788844460.569508:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267834240:0@lo:502: 00000040:00080000:2.0:1788844460.569802:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788844460.569816:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788844460.570436:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788844460.570453:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91eed8508000) 00000020:00000080:1.0:1788844460.570475:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788844460.570887:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eef3110000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788844460.570893:0:6707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eef3110000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788844460.570895:0:6707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eef3110000 3 00010000:00080000:1.0:1788844460.570929:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ef01be3000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.143@tcp at head 00010000:00010000:0.0:1788844460.574202:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788844460.574480:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788844460.574520:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788844460.574533:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7f1093851e2d90cf 00000100:00080000:0.0:1788844460.574570:0:6707:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788844460.574576:0:6707:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91ef01be3000 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:0.0:1788844460.574612:0:6707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eec6aed880 x1875739267834368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788844460.574640:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788844460.574784:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875739267834368:0@lo:38: 00000100:00100000:2.0:1788844460.574857:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844460.574923:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267834368 00000100:00100000:2.0:1788844460.574933:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267834368 00000100:00100000:2.0:1788844460.574967:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788844460.574975:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875739267834368:12345-0@lo:38: 00010000:00080000:2.0:1788844460.574998:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:2.0:1788844460.575032:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7f1093851e2d90d6 00000004:00100000:2.0:1788844460.575049:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788844460.575081:0:5838:0:(import.c:65:import_set_state_nolock()) ffff91eeff659800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788844460.575137:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875739267834368:12345-0@lo:38: Request processed in 160us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844460.575144:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788844460.575184:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eec6aed880 x1875739267834368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788844470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844460.575195:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788844460.575202:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788844460.575209:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788844460.575213:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788844460.575215:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91ef01be3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788844460.575222:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875739267834368:0@lo:38: 00000040:00080000:0.0:1788844460.577288:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788844460.577585:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788844460.577610:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788844460.577639:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.577651:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788844460.577696:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788844460.577698:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788844460.577699:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844460.577700:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844460.577701:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844460.577703:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844460.577704:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788844460.577706:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788844460.577707:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788844460.577709:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844460.577711:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788844460.577714:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788844460.577716:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788844460.577718:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788844460.577719:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844460.577720:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844460.577721:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844460.577722:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844460.577722:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788844460.577723:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788844460.577724:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788844460.577725:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844460.577726:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788844460.577751:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788844460.577768:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267834624:0@lo:253: 00000100:00100000:3.0:1788844460.577832:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.577867:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec3366600 going to sleep for 11 seconds 00000100:00100000:0.0:1788844460.578626:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267834496:0@lo:400: 00000100:00100000:0.0:1788844460.578669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.578747:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267834496 00000100:00100000:3.0:1788844460.578754:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267834496 00000100:00100000:3.0:1788844460.578807:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788844460.578824:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267834496:12345-0@lo:400: 00000100:00100000:3.0:1788844460.578879:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267834496:12345-0@lo:400: Request processed in 56us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844460.578885:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788844460.578922:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eed856ad80 x1875739267834496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844460.578935:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267834496:0@lo:400: 00000100:00100000:3.0:1788844460.579051:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267834624 00000100:00100000:3.0:1788844460.579055:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267834624 00000100:00100000:3.0:1788844460.579084:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788844460.579090:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:6682:x1875739267834624:12345-0@lo:253: 20000000:01000000:3.0:1788844460.579121:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788844460.579133:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788844460.635818:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788844460.635845:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788844460.635934:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788844460.635940:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788844460.635969:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.635989:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ef0205d400/0x7f1093851e2d903c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9035 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.635998:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.636045:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ef0205d400/0x7f1093851e2d903c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d9035 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.636062:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ef0205d400/0x7f1093851e2d903c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d9035 expref: 13 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844460.636101:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875739267834752:0@lo:104: 00000100:00100000:3.0:1788844460.636176:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844460.636242:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788844460.636449:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267834752 00000100:00100000:2.0:1788844460.636464:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267834752 00000100:00100000:2.0:1788844460.636525:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844460.639563:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:5854:x1875739267834752:12345-0@lo:104: 00010000:00010000:2.0:1788844460.639597:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d9035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844460.639846:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788844460.639856:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:5854:x1875739267834752:12345-0@lo:104: Request processed in 3320us (3677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844460.639866:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788844460.640607:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844460.640617:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d9035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.640647:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205c200 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844460.640652:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d9035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.640661:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d9035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844460.640668:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d9035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844460.640674:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788844460.640729:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d9035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.640736:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788844460.640756:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d9035 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.640762:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d9035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d903c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.640779:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844460.640781:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844460.640783:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844460.640809:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267834880:0@lo:103: 00000100:00100000:1.0:1788844460.640870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844460.640922:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267834880 00000100:00100000:1.0:1788844460.640929:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267834880 00010000:00010000:1.0:1788844460.640953:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ef0205d400/0x7f1093851e2d903c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9035 expref: 14 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844460.640986:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788844460.640994:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:3308:x1875739267834880:12345-0@lo:103: 00010000:00010000:1.0:1788844460.641005:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844460.641010:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ef0205d400/0x7f1093851e2d903c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9035 expref: 14 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.641021:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ef0205d400/0x7f1093851e2d903c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d9035 expref: 14 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.641039:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.641047:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788844460.641062:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005123070s 00010000:00010000:1.0:1788844460.641066:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.641073:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.641081:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.641087:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.641092:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844460.641096:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.641109:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.641118:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844460.641127:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844460.641156:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:3308:x1875739267834880:12345-0@lo:103: Request processed in 163us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844460.641163:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788844460.641221:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267834880:0@lo:103: 00010000:00010000:3.0:1788844460.643529:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ef0205d400/0x7f1093851e2d903c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d9035 expref: 13 pid: 5831 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844460.643570:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875739267834752:0@lo:104: 00010000:00010000:3.0:1788844460.643594:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.643605:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.643612:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844460.643618:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0024600/0x7f1093851e2d90dd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844460.656821:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:6682:x1875739267834624:12345-0@lo:253: Request processed in 77719us (78977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844460.656844:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788844460.657337:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:6682:1875739267834624:0@lo:253: 10000000:01000000:2.0:1788844460.657367:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788844460.657371:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788844460.657373:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788844460.657374:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788844460.657376:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788844460.657377:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788844460.657378:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788844460.657380:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788844460.657382:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788844460.657383:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788844460.657385:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788844460.657386:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788844460.657402:0:6682:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788844460.667222:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788844460.667428:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788844460.667670:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788844460.668020:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788844460.668239:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788844460.668497:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788844460.670292:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788844460.921757:0:6682:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788844460.921765:0:6682:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788844460.921797:0:6682:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788844460.921876:0:6682:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788844460.921892:0:6682:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788844460.921924:0:6682:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788844461.244404:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844462.266703:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844463.290795:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844464.314718:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844465.338187:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844465.915626:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267835008:0@lo:400: 00000100:00100000:3.0:1788844465.915705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844465.915780:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844465.915787:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267835136:0@lo:400: 00000100:00100000:3.0:1788844465.915816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844465.915852:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267835264:0@lo:400: 00000100:00100000:3.0:1788844465.915880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844465.915930:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267835008 00000100:00100000:3.0:1788844465.915938:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267835008 00000100:00100000:3.0:1788844465.915987:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788844465.915997:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3305:x1875739267835008:12345-0@lo:400: 00000100:00100000:3.0:1788844465.916045:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3305:x1875739267835008:12345-0@lo:400: Request processed in 50us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844465.916052:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788844465.916081:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267835136 00000100:00100000:3.0:1788844465.916085:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267835136 00000100:00100000:3.0:1788844465.916108:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267835264 00000100:00100000:3.0:1788844465.916112:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267835264 00000100:00100000:3.0:1788844465.916135:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788844465.916142:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267835136:12345-0@lo:400: 00000100:00100000:3.0:1788844465.916174:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267835136:12345-0@lo:400: Request processed in 33us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844465.916181:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788844465.916193:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788844465.916200:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267835264:12345-0@lo:400: 00000100:00100000:3.0:1788844465.916232:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267835264:12345-0@lo:400: Request processed in 33us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844465.916251:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788844465.916279:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788844465.916306:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eed856a680 x1875739267835264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844465.916321:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267835264:0@lo:400: 00010000:00080000:3.0:1788844465.916350:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eed856aa00 x1875739267835136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844465.916373:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267835136:0@lo:400: 00000100:00100000:3.0:1788844465.916385:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267835008:0@lo:400: 00010000:00010000:1.0:1788844466.363032:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844467.385910:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844468.410531:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788844468.985973:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788844468.985981:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eed0c68800 from 21 10000000:01000000:2.0:1788844468.985986:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788844468.986032:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844468.986044:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844468.986070:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844468.986095:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267835392:0@lo:101: 00000100:00100000:2.0:1788844468.986171:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844468.986249:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788844468.986377:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267835392 00000100:00100000:1.0:1788844468.986385:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267835392 00000100:00100000:1.0:1788844468.986512:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788844468.986523:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5836:x1875739267835392:12345-0@lo:101: 00010000:00010000:1.0:1788844468.986562:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844468.986584:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d90eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d90e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844468.986621:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d90eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d90e4 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844468.986632:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d90eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d90e4 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844468.986641:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bb000, rc 0) 00000100:00100000:1.0:1788844468.986693:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267835392:12345-0@lo:101: Request processed in 172us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844468.986700:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788844468.986780:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267835392:0@lo:101: 00010000:00010000:2.0:1788844468.986796:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844468.986805:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844468.986857:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267835520:0@lo:501: 00000100:00100000:2.0:1788844468.986881:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844468.996300:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788844469.000571:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267835520 00000100:00100000:3.0:1788844469.000588:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267835520 00000100:00100000:3.0:1788844469.000654:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788844469.000665:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267835520:12345-0@lo:501: 00000100:00100000:3.0:1788844469.001175:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267835520:12345-0@lo:501: Request processed in 510us (14290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844469.001198:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788844469.001350:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267835520:0@lo:501: 00000100:00100000:3.0:1788844469.001401:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267835648:0@lo:503: 00000100:00100000:3.0:1788844469.001783:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844469.002339:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788844469.005984:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267835648 00000100:00100000:1.0:1788844469.006001:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267835648 00000100:00100000:1.0:1788844469.007577:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788844469.007594:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267835648:12345-0@lo:503: 00000100:00100000:1.0:1788844469.008514:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267835648:12345-0@lo:503: Request processed in 921us (6726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844469.008525:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788844469.008759:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267835648:0@lo:503: 00000100:00100000:2.0:1788844469.009121:0:7017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7017:1875739267835776:0@lo:502: 00000100:00100000:2.0:1788844469.009166:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.010533:0:7017:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788844469.010627:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267835776 00000100:00100000:1.0:1788844469.010636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267835776 00000100:00100000:1.0:1788844469.010743:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788844469.010754:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7017:x1875739267835776:12345-0@lo:502: 00000100:00100000:1.0:1788844469.011119:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7017:x1875739267835776:12345-0@lo:502: Request processed in 365us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844469.011128:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788844469.012487:0:7017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7017:1875739267835776:0@lo:502: 00000100:00100000:2.0:1788844469.015810:0:7017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7017:1875739267835904:0@lo:502: 00000100:00100000:2.0:1788844469.015904:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.015955:0:7017:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788844469.016063:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267835904 00000100:00100000:3.0:1788844469.016072:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267835904 00000100:00100000:3.0:1788844469.016127:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788844469.016136:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7017:x1875739267835904:12345-0@lo:502: 00000100:00100000:3.0:1788844469.016935:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7017:x1875739267835904:12345-0@lo:502: Request processed in 797us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844469.016945:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788844469.017080:0:7017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7017:1875739267835904:0@lo:502: 00000040:00080000:2.0:1788844469.017125:0:7017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788844469.017775:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788844469.017795:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788844469.017805:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844469.017822:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844469.017832:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788844469.017835:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eed0c68800 from 4 10000000:01000000:3.0:1788844469.017838:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788844469.017872:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844469.017880:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844469.017890:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844469.017910:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267836032:0@lo:101: 00000100:00100000:3.0:1788844469.017952:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844469.017987:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844469.018060:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267836032 00000100:00100000:0.0:1788844469.018067:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267836032 00000100:00100000:0.0:1788844469.018106:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788844469.018114:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267836032:12345-0@lo:101: 00010000:00010000:0.0:1788844469.018126:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844469.018139:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5526800/0x7f1093851e2d90f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d90f2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844469.018162:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526800/0x7f1093851e2d90f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d90f2 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844469.018172:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5526800/0x7f1093851e2d90f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d90f2 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844469.018203:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526800, rc 0) 00000100:00100000:0.0:1788844469.018568:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267836032:12345-0@lo:101: Request processed in 453us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844469.018594:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788844469.019862:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267836032:0@lo:101: 00010000:00010000:2.0:1788844469.019888:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844469.019899:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844469.021353:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267836160:0@lo:256: 00000100:00100000:2.0:1788844469.022855:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.022910:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788844469.024501:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267836160 00000100:00100000:0.0:1788844469.024514:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267836160 00000100:00100000:0.0:1788844469.024588:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788844469.024598:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267836160:12345-0@lo:256: 20000000:01000000:0.0:1788844469.024623:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788844469.024641:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788844469.024644:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788844469.024772:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267836160:12345-0@lo:256: Request processed in 175us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844469.024780:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788844469.025208:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267836160:0@lo:256: 10000000:01000000:2.0:1788844469.025271:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788844469.025282:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844469.025293:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844469.025303:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788844469.025305:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788844469.025308:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788844469.025339:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844469.025347:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844469.025369:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844469.025387:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267836288:0@lo:101: 00000100:00100000:2.0:1788844469.025424:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.025460:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788844469.025643:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267836288 00000100:00100000:0.0:1788844469.025649:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267836288 00000100:00100000:0.0:1788844469.025693:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788844469.025701:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267836288:12345-0@lo:101: 00010000:00010000:0.0:1788844469.025711:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844469.025724:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5527000/0x7f1093851e2d9107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9100 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844469.025749:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5527000/0x7f1093851e2d9107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9100 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844469.025761:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5527000/0x7f1093851e2d9107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9100 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844469.025783:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527000, rc 0) 00000100:00100000:0.0:1788844469.025827:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267836288:12345-0@lo:101: Request processed in 126us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844469.025833:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788844469.025961:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267836288:0@lo:101: 00010000:00010000:3.0:1788844469.025975:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844469.025984:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844469.026035:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267836416:0@lo:501: 00000100:00100000:3.0:1788844469.026063:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844469.026098:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788844469.026151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267836416 00000100:00100000:2.0:1788844469.026155:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267836416 00000100:00100000:2.0:1788844469.026195:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788844469.026203:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267836416:12345-0@lo:501: 00000100:00100000:2.0:1788844469.026460:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267836416:12345-0@lo:501: Request processed in 257us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844469.026466:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788844469.026497:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267836416:0@lo:501: 00000100:00100000:2.0:1788844469.026525:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3171500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267836544:0@lo:503: 00000100:00100000:2.0:1788844469.026582:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.026596:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844469.026606:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267836544 00000100:00100000:2.0:1788844469.026609:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267836544 00000100:00100000:2.0:1788844469.026625:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788844469.026631:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267836544:12345-0@lo:503: 00000100:00100000:2.0:1788844469.027150:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267836544:12345-0@lo:503: Request processed in 517us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844469.027157:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788844469.031782:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3171500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267836544:0@lo:503: 00000100:00100000:2.0:1788844469.032960:0:7020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7020:1875739267836672:0@lo:502: 00000100:00100000:2.0:1788844469.033049:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.033091:0:7020:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844469.034365:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267836672 00000100:00100000:3.0:1788844469.034381:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267836672 00000100:00100000:3.0:1788844469.034438:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788844469.034448:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:7020:x1875739267836672:12345-0@lo:502: 00000100:00100000:3.0:1788844469.035089:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:7020:x1875739267836672:12345-0@lo:502: Request processed in 639us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844469.035101:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788844469.035212:0:7020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7020:1875739267836672:0@lo:502: 00000020:01000000:2.0:1788844469.035258:0:7020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788844469.035266:0:7020:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788844469.035273:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844469.035276:0:7020:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788844469.035281:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788844469.035285:0:7020:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.143@tcp to nid 0x20000c0a8cc8f (192.168.204.143@tcp) 00000020:01000000:2.0:1788844469.035311:0:7020:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788844469.035314:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788844469.035329:0:7020:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91eeff3e8000) 00000020:00000080:2.0:1788844469.035350:0:7020:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788844469.035356:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788844469.035449:0:7020:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788844469.035455:0:7020:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788844469.035462:0:7020:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2d9115 00010000:00080000:2.0:1788844469.035513:0:7020:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eeff13f800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:2.0:1788844469.036017:0:7020:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788844469.099881:0:7020:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788844469.099910:0:7020:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788844469.101139:0:7020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788844469.101370:0:7020:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788844469.101420:0:7020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788844469.102883:0:7020:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788844469.107298:0:7024:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788844469.107308:0:7024:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788844469.112384:0:7020:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788844469.112400:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788844469.112492:0:7020:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788844469.112514:0:7020:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7f1093851e2d911c 00000100:00080000:3.0:1788844469.112526:0:7020:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788844469.112532:0:7020:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91eeff13f800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1788844469.113027:0:7020:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eed8568380 x1875739267836800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788844469.113054:0:7020:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788844469.113112:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267836800:0@lo:8: 00000100:00100000:2.0:1788844469.113208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788844469.121096:0:7020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788844469.121106:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844469.121114:0:7020:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788844469.121121:0:7020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788844469.121126:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844469.121127:0:7020:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788844469.121130:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788844469.121132:0:7020:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788844469.121185:0:7020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3173b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7020:1875739267836928:0@lo:502: 00000100:00100000:2.0:1788844469.123114:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.123170:0:7020:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc2000 going to sleep for 11 seconds 00000100:00100000:3.0:1788844469.123624:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267836800 00000100:00100000:3.0:1788844469.123632:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267836800 00000100:00100000:3.0:1788844469.123683:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788844469.123691:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875739267836800:12345-0@lo:8: 00010000:00080000:3.0:1788844469.123720:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:3.0:1788844469.123750:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7f1093851e2d9123 00002000:00100000:3.0:1788844469.123794:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91eef930a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788844469.123799:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788844469.123815:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788844469.123941:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788844469.124083:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788844469.124108:0:6686:0:(import.c:65:import_set_state_nolock()) ffff91eef930e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788844469.124201:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875739267836800:12345-0@lo:8: Request processed in 509us (10993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844469.124210:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788844469.124246:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788844469.124259:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267837056:0@lo:400: 00000100:00100000:3.0:1788844469.124299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844469.124332:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267837184:0@lo:400: 00000100:00100000:3.0:1788844469.124354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844469.124387:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267837056 00000100:00100000:3.0:1788844469.124391:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267837056 00000100:00100000:3.0:1788844469.124420:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267837184 00000100:00100000:3.0:1788844469.124423:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267837184 00000100:00100000:3.0:1788844469.124446:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788844469.124452:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267837056:12345-0@lo:400: 00000100:00100000:3.0:1788844469.124491:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267837056:12345-0@lo:400: Request processed in 39us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844469.124498:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788844469.124511:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788844469.124516:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267837184:12345-0@lo:400: 00000100:00100000:3.0:1788844469.124583:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267837184:12345-0@lo:400: Request processed in 67us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844469.124588:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788844469.124610:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788844469.124638:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eed856b800 x1875739267837056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844469.124661:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267837056:0@lo:400: 00010000:00080000:3.0:1788844469.124692:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eed856a680 x1875739267837184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844469.124700:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267837184:0@lo:400: 00010000:00080000:3.0:1788844469.124757:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eed8568380 x1875739267836800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788844479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844469.124766:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788844469.124773:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788844469.124781:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788844469.124786:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788844469.124788:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eeff13f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788844469.124799:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788844469.124804:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267836800:0@lo:8: 00000004:00080000:1.0:1788844469.125134:0:7024:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788844469.125275:0:7024:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 183403738038ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788844469.131142:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267836928 00000100:00100000:0.0:1788844469.131159:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267836928 00000100:00100000:0.0:1788844469.131239:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788844469.131249:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:7020:x1875739267836928:12345-0@lo:502: 00000100:00100000:0.0:1788844469.149101:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:7020:x1875739267836928:12345-0@lo:502: Request processed in 17844us (25985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844469.149116:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788844469.153334:0:7020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3173b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7020:1875739267836928:0@lo:502: 00000020:01000000:2.0:1788844469.153389:0:7020:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788844469.153399:0:7020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844469.153402:0:7020:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788844469.153408:0:7020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788844469.153486:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788844469.153504:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788844469.153516:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844469.153529:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844469.153557:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788844469.153560:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91eed850cd28 from 1 10000000:01000000:2.0:1788844469.153563:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788844469.153610:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844469.153619:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844469.153645:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844469.153665:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267837312:0@lo:101: 00000100:00100000:2.0:1788844469.153736:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.153785:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc2000 going to sleep for 11 seconds 00000100:00100000:3.0:1788844469.155374:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267837312 00000100:00100000:3.0:1788844469.155392:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267837312 00000100:00100000:3.0:1788844469.155457:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788844469.155468:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267837312:12345-0@lo:101: 00010000:00010000:3.0:1788844469.155483:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844469.155501:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d912a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844469.155528:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d912a expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844469.155557:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d912a expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844469.155590:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024800, rc 0) 00000100:00100000:3.0:1788844469.155683:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267837312:12345-0@lo:101: Request processed in 217us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844469.155690:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788844469.155739:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267837312:0@lo:101: 00010000:00010000:3.0:1788844469.155755:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844469.155765:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844469.155825:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267837440:0@lo:501: 00000100:00100000:3.0:1788844469.155855:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844469.162796:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788844469.173598:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267837440 00000100:00100000:2.0:1788844469.173620:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267837440 00000100:00100000:2.0:1788844469.173676:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788844469.173686:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267837440:12345-0@lo:501: 00000100:00100000:2.0:1788844469.173901:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267837440:12345-0@lo:501: Request processed in 215us (18044us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788844469.173909:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788844469.174314:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267837440:0@lo:501: 10000000:01000000:3.0:1788844469.174356:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788844469.174366:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844469.174377:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788844469.223798:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788844469.286003:0:7026:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788844469.286041:0:7026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1875739267837696:0@lo:7: 00000100:00100000:2.0:1788844469.286115:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.286187:0:7026:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec31b8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788844469.286222:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267837568:0@lo:13: 00000100:00100000:2.0:1788844469.286250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.286296:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267837696 00000100:00100000:2.0:1788844469.286303:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267837696 00000100:00100000:2.0:1788844469.286360:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788844469.286370:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7026:x1875739267837696:12345-0@lo:7: 00000100:00080000:3.0:1788844469.287612:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844469.287637:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267837568 00000100:00100000:3.0:1788844469.287645:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267837568 00000100:00100000:3.0:1788844469.287827:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788844469.287845:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875739267837568:12345-0@lo:13: 00002000:00000024:3.0:1788844469.287872:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788844469.287951:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875739267837568:12345-0@lo:13: Request processed in 108us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844469.287958:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788844469.288081:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eef3173100 x1875739267837568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844469.288102:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267837568:0@lo:13: 00002000:00080000:2.0:1788844469.297344:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788844469.297353:0:6688:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788844469.297456:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7026:x1875739267837696:12345-0@lo:7: Request processed in 11082us (11336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844469.297474:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788844469.301254:0:7026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eef3170700 x1875739267837696/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788844485 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844469.301274:0:7026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1875739267837696:0@lo:7: 00000004:00080000:3.0:1788844469.301290:0:7026:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788844469.301335:0:7026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1875739267837824:0@lo:5: 00000100:00100000:3.0:1788844469.301395:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844469.301442:0:7026:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788844469.301793:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267837824 00000100:00100000:1.0:1788844469.301802:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267837824 00000100:00100000:1.0:1788844469.301856:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788844469.301866:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7026:x1875739267837824:12345-0@lo:5: 00002000:00080000:1.0:1788844469.301894:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788844469.301898:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788844469.303079:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7026:x1875739267837824:12345-0@lo:5: Request processed in 1206us (1675us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788844469.303091:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788844469.309049:0:7026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eed8568380 x1875739267837824/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788844485 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844469.309071:0:7026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1875739267837824:0@lo:5: 00000004:00080000:2.0:1788844469.309088:0:7026:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788844469.309134:0:7026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3171f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1875739267837952:0@lo:700: 00000100:00100000:2.0:1788844469.309208:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844469.309249:0:7026:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788844469.313136:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267837952 00000100:00100000:0.0:1788844469.313154:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267837952 00000100:00100000:0.0:1788844469.313231:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844469.313242:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7026:x1875739267837952:12345-0@lo:700: 00000100:00100000:0.0:1788844469.313304:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1875739267838080:0@lo:700: 00000100:00100000:0.0:1788844469.313372:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844469.313403:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1334f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788844469.318021:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267838080 00000100:00100000:3.0:1788844469.318038:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267838080 00000100:00100000:3.0:1788844469.318130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788844469.318140:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1875739267838080:12345-0@lo:700: 40000000:02000000:3.0:1788844469.396263:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788844469.409661:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1875739267838080:12345-0@lo:700: Request processed in 91512us (96278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844469.409677:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788844469.409748:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eec6aefb80 x1875739267838080/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788844485 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844469.409763:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1875739267838080:0@lo:700: 40000000:02000000:3.0:1788844469.409775:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:0.0:1788844469.436888:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788844469.471363:0:7054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788844469.582622:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7026:x1875739267837952:12345-0@lo:700: Request processed in 269370us (273402us total) trans 0 rc 0/0 00010000:00080000:1.0:1788844469.582782:0:7026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eef3171f80 x1875739267837952/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788844485 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844469.582799:0:7026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3171f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1875739267837952:0@lo:700: 00000100:00100000:3.0:1788844469.583185:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1788844469.583227:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788844469.583247:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1788844469.714637:0:7026:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788844469.745690:0:7026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1875739267838208:0@lo:5: 00000100:00100000:1.0:1788844469.745768:0:7026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844469.745826:0:7026:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec7050e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788844469.746217:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267838208 00000100:00100000:0.0:1788844469.746226:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267838208 00000100:00100000:0.0:1788844469.746282:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788844469.746288:0:6686:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788844469.746291:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7026:x1875739267838208:12345-0@lo:5: 00000100:00100000:3.0:1788844469.746296:0:6686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1788844469.777201:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788844469.777233:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788844469.785803:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7026:x1875739267838208:12345-0@lo:5: Request processed in 39506us (40027us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788844469.785817:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788844469.785847:0:7026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eefb6d7b80 x1875739267838208/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788844485 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844469.785862:0:7026:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788844469.785881:0:7026:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91eefb6d7b80 x1875739267838208/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788844485 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844469.785894:0:7026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7026:1875739267838208:0@lo:5: 00000004:00080000:2.0:1788844469.785910:0:7026:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1788844470.457699:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844471.496441:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844472.509252:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844473.544147:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844474.553798:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844474.618078:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267838592:0@lo:400: 00000100:00100000:3.0:1788844474.618150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844474.618209:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844474.618216:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267838720:0@lo:400: 00000100:00100000:3.0:1788844474.618244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844474.618280:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267838592 00000100:00100000:3.0:1788844474.618288:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267838592 00000100:00100000:3.0:1788844474.618350:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788844474.618360:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267838592:12345-0@lo:400: 00000100:00100000:3.0:1788844474.618414:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267838592:12345-0@lo:400: Request processed in 55us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844474.618421:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788844474.618446:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788844474.618479:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eed856b100 x1875739267838592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844474.618494:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267838592:0@lo:400: 00000100:00100000:1.0:1788844474.618695:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267838336:0@lo:400: 00000100:00100000:1.0:1788844474.618751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844474.618776:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788844474.618782:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267838464:0@lo:400: 00000100:00100000:1.0:1788844474.618822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844474.618856:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267838720 00000100:00100000:1.0:1788844474.618860:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267838720 00000100:00100000:1.0:1788844474.618898:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788844474.618906:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875739267838720:12345-0@lo:400: 00000100:00100000:1.0:1788844474.618945:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875739267838720:12345-0@lo:400: Request processed in 41us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844474.618953:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788844474.618982:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267838464 00000100:00100000:1.0:1788844474.618985:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267838464 00000100:00100000:1.0:1788844474.619007:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788844474.619013:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267838464:12345-0@lo:400: 00000100:00100000:1.0:1788844474.619047:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267838464:12345-0@lo:400: Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844474.619052:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788844474.619079:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788844474.619097:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eed8569f80 x1875739267838464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844474.619108:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267838464:0@lo:400: 00010000:00080000:1.0:1788844474.619133:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eed8568000 x1875739267838720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844474.619142:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267838720:0@lo:400: 00000100:00100000:3.0:1788844474.622779:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267838848:0@lo:13: 00000100:00100000:3.0:1788844474.622848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844474.622907:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267838848 00000100:00100000:3.0:1788844474.622915:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267838848 00000100:00100000:3.0:1788844474.622956:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788844474.622964:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267838848:12345-0@lo:13: 00002000:00000024:3.0:1788844474.622996:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844474.623032:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267838848:12345-0@lo:13: Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844474.623039:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788844474.623091:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eed856b100 x1875739267838848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844474.623112:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267838848:0@lo:13: 00000100:00100000:2.0:1788844474.629474:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267838336 00000100:00100000:2.0:1788844474.629490:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267838336 00000100:00100000:2.0:1788844474.629569:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788844474.629580:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3307:x1875739267838336:12345-0@lo:400: 00000100:00100000:2.0:1788844474.629675:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3307:x1875739267838336:12345-0@lo:400: Request processed in 97us (10923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844474.629682:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788844474.631695:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267838336:0@lo:400: 00000001:00080000:0.0:1788844474.761342:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788844475.578723:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844476.601757:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844477.632490:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844478.650765:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844479.674980:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844479.743683:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788844479.743709:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267838976:0@lo:13: 00000100:00100000:1.0:1788844479.743777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844479.743857:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267838976 00000100:00100000:1.0:1788844479.743864:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267838976 00000100:00100000:1.0:1788844479.743915:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788844479.743923:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267838976:12345-0@lo:13: 00002000:00000024:1.0:1788844479.743958:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844479.744011:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267838976:12345-0@lo:13: Request processed in 88us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844479.744018:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788844479.744049:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788844479.744077:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eefb6d4000 x1875739267838976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844479.744087:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788844479.744109:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267838976:0@lo:13: 00000100:00100000:1.0:1788844479.747668:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267839104:0@lo:400: 00000100:00100000:1.0:1788844479.747737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844479.747777:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844479.747782:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267839232:0@lo:400: 00000100:00100000:1.0:1788844479.747803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844479.747826:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788844479.747831:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267839360:0@lo:400: 00000100:00100000:1.0:1788844479.747869:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844479.747895:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267839104 00000100:00100000:1.0:1788844479.747902:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267839104 00000100:00100000:1.0:1788844479.747943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788844479.747951:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3305:x1875739267839104:12345-0@lo:400: 00000100:00100000:1.0:1788844479.748014:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3305:x1875739267839104:12345-0@lo:400: Request processed in 63us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844479.748030:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788844479.748071:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267839232 00000100:00100000:1.0:1788844479.748074:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267839232 00000100:00100000:1.0:1788844479.748094:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267839360 00000100:00100000:1.0:1788844479.748096:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267839360 00000100:00100000:1.0:1788844479.748114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788844479.748120:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267839232:12345-0@lo:400: 00000100:00100000:1.0:1788844479.748147:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267839232:12345-0@lo:400: Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844479.748153:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788844479.748162:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788844479.748166:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267839360:12345-0@lo:400: 00000100:00100000:1.0:1788844479.748188:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267839360:12345-0@lo:400: Request processed in 22us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844479.748194:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788844479.748215:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788844479.748240:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eefb6d5f80 x1875739267839360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844479.748254:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267839360:0@lo:400: 00010000:00080000:1.0:1788844479.748277:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eefb6d7b80 x1875739267839232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844479.748285:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267839232:0@lo:400: 00000100:00100000:1.0:1788844479.748292:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267839104:0@lo:400: 00010000:00010000:1.0:1788844480.701559:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844481.722139:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844482.747124:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844483.769765:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788844483.787155:0:7623:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788844483.787159:0:7623:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788844483.787293:0:7623:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91eefacdc000 00000020:01000004:2.0:1788844483.787308:0:7623:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788844483.787321:0:7623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788844483.787335:0:7623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91eeff3e99b8) 00000020:00000080:2.0:1788844483.787351:0:7623:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788844483.831938:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788844483.832180:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788844483.927063:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788844483.935463:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788844483.935496:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788844483.935571:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788844483.935597:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788844483.935986:0:7623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788844483.935998:0:7623:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788844483.936006:0:7623:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7f1093851e2d913f 00000020:01000004:0.0:1788844483.936013:0:7623:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788844483.936033:0:7623:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.143@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788844483.936036:0:7623:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788844483.936041:0:7623:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788844483.936060:0:7623:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788844483.936064:0:7623:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788844483.975709:0:7623:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788844483.975745:0:7623:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.143@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788844483.975749:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788844483.975751:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788844483.975753:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788844483.975754:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788844483.975755:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788844483.975756:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788844483.975758:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788844483.975759:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788844483.975761:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788844483.975762:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788844483.975763:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788844483.975767:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788844483.975769:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788844483.975770:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788844483.975771:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788844483.975772:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788844483.975773:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788844483.975774:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788844483.975775:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788844483.975777:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788844483.975777:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788844483.975778:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788844483.975779:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788844483.975808:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788844483.975831:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3171f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267839488:0@lo:253: 00000100:00100000:2.0:1788844483.980564:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844483.980827:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267839488 00000100:00100000:3.0:1788844483.980838:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267839488 00000100:00100000:3.0:1788844483.980903:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788844483.980914:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:7623:x1875739267839488:12345-0@lo:253: 20000000:01000000:3.0:1788844483.980951:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788844483.980956:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788844483.980961:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788844483.980965:0:5831:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000100:00100000:0.0:1788844483.981867:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2bd8780 going to sleep for 11 seconds 00000040:00080000:3.0:1788844483.982186:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788844483.983337:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788844483.983358:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788844483.983477:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788844483.983486:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788844483.983527:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788844483.984068:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788844483.984500:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788844483.984520:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.143@tcp 20000000:01000000:3.0:1788844483.984523:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.143@tcp (null) (null) (null) 00000040:00080000:3.0:1788844483.984591:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788844483.984600:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788844483.984652:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788844483.984660:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.143@tcp (null) (null) 00000040:00080000:3.0:1788844483.984708:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788844483.984860:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788844483.984911:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788844483.984965:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788844483.986643:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788844483.986671:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.143@tcp 20000000:01000000:3.0:1788844483.986673:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.143@tcp (null) (null) (null) 00000040:00080000:3.0:1788844483.986704:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788844483.986711:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788844483.986867:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788844483.986875:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.143@tcp (null) (null) 00000040:00080000:3.0:1788844483.986916:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788844483.986924:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788844483.986965:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788844483.986997:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788844483.987011:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788844483.987014:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788844483.987020:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788844483.987021:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788844483.987023:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788844483.987036:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788844483.987039:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788844483.987071:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788844483.987080:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788844483.999013:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788844483.999364:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788844483.999421:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788844483.999494:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788844483.999507:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788844483.999509:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788844484.001991:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788844484.002065:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788844484.002112:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788844484.002388:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788844484.002428:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788844484.002479:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788844484.002493:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788844484.002495:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788844484.003127:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788844484.003176:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788844484.003227:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788844484.003649:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788844484.003690:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788844484.003806:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788844484.003820:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788844484.003822:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788844484.006231:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788844484.006321:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788844484.006349:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788844484.009213:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788844484.009261:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788844484.009316:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1788844484.009337:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788844484.009355:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.009372:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9090 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.009469:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed99ba000/0x7f1093851e2d90c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d90ba expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.009476:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d90eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d90e4 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.009483:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5527000/0x7f1093851e2d9107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9100 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.009489:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d912a expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.009498:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.009561:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d912a expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.009578:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9131 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d912a expref: 16 pid: 5831 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.009594:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267839616:0@lo:104: 00000100:00100000:0.0:1788844484.009669:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788844484.011019:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5527000/0x7f1093851e2d9107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d9100 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.011033:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5527000/0x7f1093851e2d9107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d9100 expref: 16 pid: 5831 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.011047:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267839744:0@lo:104: 00010000:00010000:0.0:1788844484.011114:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d90eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d90e4 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.011123:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d90eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d90e4 expref: 16 pid: 5834 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.011130:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267839872:0@lo:104: 00010000:00010000:0.0:1788844484.011166:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed99ba000/0x7f1093851e2d90c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d90ba expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.011175:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eed99ba000/0x7f1093851e2d90c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d90ba expref: 16 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.011182:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aedf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267840000:0@lo:104: 00010000:00010000:0.0:1788844484.011201:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d9090 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.011207:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d9090 expref: 16 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.011215:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aefb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267840128:0@lo:104: 00000100:00100000:0.0:1788844484.011229:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed0389cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844484.011324:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788844484.011346:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.011373:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.011391:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.011399:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.011410:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267839616 00000100:00100000:2.0:1788844484.011416:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267839616 00000100:00100000:2.0:1788844484.011449:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267839744 00000100:00100000:2.0:1788844484.011451:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267839744 00000100:00100000:2.0:1788844484.011458:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267839872 00000100:00100000:2.0:1788844484.011460:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267839872 00000100:00100000:2.0:1788844484.011467:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267840000 00000100:00100000:2.0:1788844484.011469:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267840000 00000100:00100000:2.0:1788844484.011476:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267840128 00000100:00100000:2.0:1788844484.011477:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267840128 00000100:00100000:2.0:1788844484.011489:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788844484.011496:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4f50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+7:5831:x1875739267839616:12345-0@lo:104: 00010000:00010000:2.0:1788844484.011516:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.011590:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788844484.011597:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4f50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+7:5831:x1875739267839616:12345-0@lo:104: Request processed in 101us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.011605:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788844484.011642:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788844484.011648:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+6:5831:x1875739267839744:12345-0@lo:104: 00010000:00010000:2.0:1788844484.011655:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.011682:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788844484.011687:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+6:5831:x1875739267839744:12345-0@lo:104: Request processed in 40us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.011693:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788844484.011703:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788844484.011708:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:5831:x1875739267839872:12345-0@lo:104: 00010000:00010000:2.0:1788844484.011714:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.011750:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788844484.011754:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:5831:x1875739267839872:12345-0@lo:104: Request processed in 47us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.011760:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788844484.011770:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788844484.011775:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3173b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:5831:x1875739267840000:12345-0@lo:104: 00010000:00010000:2.0:1788844484.011787:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.011809:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788844484.011813:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3173b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:5831:x1875739267840000:12345-0@lo:104: Request processed in 39us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.011819:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788844484.011829:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788844484.011834:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:5831:x1875739267840128:12345-0@lo:104: 00010000:00010000:2.0:1788844484.011840:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.011860:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788844484.011864:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:5831:x1875739267840128:12345-0@lo:104: Request processed in 31us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.011869:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788844484.011882:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788844484.011898:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.011906:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205ca00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844484.011911:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.011921:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844484.011929:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844484.011940:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788844484.011967:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.011973:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844484.011990:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.011998:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d912a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9131 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012024:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788844484.012027:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012032:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205da00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844484.012036:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012043:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844484.012049:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844484.012055:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788844484.012065:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012071:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844484.012087:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012095:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d9100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012105:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788844484.012108:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012114:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205c200 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844484.012117:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012123:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844484.012130:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844484.012135:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788844484.012145:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012151:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844484.012155:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012161:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d90e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012170:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788844484.012177:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012183:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526e00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844484.012187:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012193:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844484.012199:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844484.012205:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788844484.012215:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012220:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844484.012225:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012231:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec5526e00/0x7f1093851e2d90ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90c1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012239:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844484.012241:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012248:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844484.012251:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012266:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844484.012273:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844484.012279:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788844484.012288:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012293:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844484.012297:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012304:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2d9090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9097 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012316:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844484.012317:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844484.012319:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844484.012325:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844484.012341:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267840256:0@lo:103: 00000100:00100000:2.0:1788844484.012368:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.012385:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267840768:0@lo:103: 00000100:00100000:2.0:1788844484.012400:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.012415:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788844484.012420:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267840640:0@lo:103: 00000100:00100000:2.0:1788844484.012445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.012474:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267840384:0@lo:103: 00000100:00100000:2.0:1788844484.012492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.012502:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788844484.012506:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267840512:0@lo:103: 00000100:00100000:2.0:1788844484.012520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.012559:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267840256 00000100:00100000:2.0:1788844484.012564:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267840256 00010000:00010000:2.0:1788844484.012590:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9131 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d912a expref: 17 pid: 5831 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844484.012604:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267840768 00000100:00100000:2.0:1788844484.012607:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267840768 00010000:00010000:2.0:1788844484.012616:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9097 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9090 expref: 18 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844484.012624:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267840640 00000100:00100000:2.0:1788844484.012626:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267840640 00010000:00010000:2.0:1788844484.012633:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed99ba000/0x7f1093851e2d90c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d90ba expref: 19 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844484.012641:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267840384 00000100:00100000:2.0:1788844484.012643:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267840384 00010000:00010000:2.0:1788844484.012650:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5527000/0x7f1093851e2d9107 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9100 expref: 20 pid: 5831 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844484.012659:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267840512 00000100:00100000:2.0:1788844484.012661:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267840512 00010000:00010000:2.0:1788844484.012668:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d90eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d90e4 expref: 21 pid: 5834 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844484.012677:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788844484.012682:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+21:3308:x1875739267840256:12345-0@lo:103: 00010000:00010000:2.0:1788844484.012697:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844484.012702:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9131 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d912a expref: 21 pid: 5831 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012711:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9131 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d912a expref: 21 pid: 5831 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012727:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844484.012753:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+21:3308:x1875739267840256:12345-0@lo:103: Request processed in 71us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.012759:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788844484.012771:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788844484.012777:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+20:3308:x1875739267840768:12345-0@lo:103: 00010000:00010000:2.0:1788844484.012784:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844484.012788:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9097 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9090 expref: 20 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012795:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d9090 expref: 20 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012804:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844484.012823:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+20:3308:x1875739267840768:12345-0@lo:103: Request processed in 46us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.012829:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788844484.012838:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788844484.012842:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267840640:12345-0@lo:103: 00010000:00010000:2.0:1788844484.012849:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844484.012853:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed99ba000/0x7f1093851e2d90c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d90ba expref: 19 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012866:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed99ba000/0x7f1093851e2d90c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d90ba expref: 19 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012874:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844484.012910:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267840640:12345-0@lo:103: Request processed in 68us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.012916:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788844484.012928:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788844484.012934:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:3305:x1875739267840384:12345-0@lo:103: 00010000:00010000:2.0:1788844484.012940:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844484.012944:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5527000/0x7f1093851e2d9107 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9100 expref: 18 pid: 5831 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012952:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5527000/0x7f1093851e2d9107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d9100 expref: 18 pid: 5831 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.012961:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844484.012984:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:3305:x1875739267840384:12345-0@lo:103: Request processed in 51us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.012990:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788844484.013000:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788844484.013005:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:3305:x1875739267840512:12345-0@lo:103: 00010000:00010000:2.0:1788844484.013012:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844484.013016:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d90eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d90e4 expref: 17 pid: 5834 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013024:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d90eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d90e4 expref: 17 pid: 5834 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013041:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013048:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013060:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013067:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013074:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013080:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013086:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844484.013090:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013097:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013105:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.013113:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844484.013135:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:3305:x1875739267840512:12345-0@lo:103: Request processed in 129us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.013148:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788844484.013189:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267840512:0@lo:103: 00000100:00100000:2.0:1788844484.013197:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267840384:0@lo:103: 00000100:00100000:2.0:1788844484.013220:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267840640:0@lo:103: 00000100:00100000:2.0:1788844484.013228:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267840256:0@lo:103: 00000100:00100000:2.0:1788844484.013235:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267840768:0@lo:103: 00010000:00010000:0.0:1788844484.015410:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9131 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d912a expref: 16 pid: 5831 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.015429:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267839616:0@lo:104: 00010000:00010000:0.0:1788844484.015441:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5527000/0x7f1093851e2d9107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d9100 expref: 15 pid: 5831 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.015468:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267839744:0@lo:104: 00010000:00010000:0.0:1788844484.015479:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d90eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d90e4 expref: 14 pid: 5834 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.015488:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267839872:0@lo:104: 00010000:00010000:0.0:1788844484.015497:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99ba000/0x7f1093851e2d90c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d90ba expref: 13 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.015504:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aedf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267840000:0@lo:104: 00010000:00010000:0.0:1788844484.015512:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d9090 expref: 12 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.015519:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aefb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875739267840128:0@lo:104: 00010000:00010000:0.0:1788844484.015572:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.015582:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.015588:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.015594:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526000/0x7f1093851e2d9146 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788844484.015608:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788844484.090238:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:7623:x1875739267839488:12345-0@lo:253: Request processed in 109315us (109671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844484.090253:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788844484.090357:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3171f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267839488:0@lo:253: 10000000:01000000:0.0:1788844484.090401:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788844484.090404:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788844484.090406:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788844484.090407:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844484.090408:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788844484.090410:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844484.090412:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844484.090413:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788844484.090415:0:7623:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788844484.090417:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844484.090418:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788844484.090439:0:7623:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91eefacdc000 from lustre-OST0001 10000000:01000000:0.0:1788844484.090466:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788844484.090469:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788844484.090476:0:7623:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91eed850cd28 local copy 10000000:01000000:0.0:1788844484.090481:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788844484.090515:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.090526:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.090553:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.090573:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aefb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267840896:0@lo:101: 00000100:00100000:0.0:1788844484.090611:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844484.090701:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed03899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844484.090965:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267840896 00000100:00100000:1.0:1788844484.090972:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267840896 00000100:00100000:1.0:1788844484.091055:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788844484.091064:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:7623:x1875739267840896:12345-0@lo:101: 00010000:00010000:1.0:1788844484.091078:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844484.091093:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d9154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d914d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844484.091118:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d9154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d914d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844484.091129:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d9154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d914d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844484.091138:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99ba800, rc 0) 00000100:00100000:1.0:1788844484.091228:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267840896:12345-0@lo:101: Request processed in 164us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844484.091234:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788844484.091284:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aefb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267840896:0@lo:101: 00010000:00010000:2.0:1788844484.091297:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.091306:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844484.091502:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01670700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841024:0@lo:501: 00000100:00100000:2.0:1788844484.091528:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.091580:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67180 going to sleep for 11 seconds 00000100:00100000:0.0:1788844484.091631:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267841024 00000100:00100000:0.0:1788844484.091636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267841024 00000100:00100000:0.0:1788844484.091670:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788844484.091677:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841024:12345-0@lo:501: 00000100:00100000:0.0:1788844484.091870:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841024:12345-0@lo:501: Request processed in 193us (340us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788844484.091877:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788844484.092043:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01670700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841024:0@lo:501: 10000000:01000000:3.0:1788844484.092056:0:7623:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788844484.092080:0:7623:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788844484.092084:0:7623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.092092:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.092099:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.092119:0:7623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788844484.092136:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91eefacdc000 10000000:01000000:3.0:1788844484.092140:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788844484.092145:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788844484.092147:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788844484.092150:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788844484.092153:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788844484.092168:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.092185:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.092194:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844484.092204:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841152:0@lo:101: 00000100:00100000:3.0:1788844484.092231:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.092250:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8180 going to sleep for 11 seconds 00010000:00010000:2.0:1788844484.092294:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844484.092300:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.092308:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526000 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844484.092312:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.092320:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844484.092333:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844484.092339:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788844484.092356:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.092361:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844484.092392:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.092399:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec5526000/0x7f1093851e2d914d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7f1093851e2d9154 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.092410:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844484.092412:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844484.092413:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844484.092420:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788844484.092430:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267841280:0@lo:103: 00000100:00100000:2.0:1788844484.092456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.092478:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267841280 00000100:00100000:2.0:1788844484.092482:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267841280 00000100:00100000:2.0:1788844484.092509:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788844484.092516:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3306:x1875739267841280:12345-0@lo:103: 00010000:00010000:2.0:1788844484.092525:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844484.092568:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d9154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d914d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.092581:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844484.092615:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:3306:x1875739267841280:12345-0@lo:103: Request processed in 99us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.092621:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788844484.092649:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267841280:0@lo:103: 00000100:00100000:0.0:1788844484.092851:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267841152 00000100:00100000:0.0:1788844484.092855:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267841152 00000100:00100000:0.0:1788844484.092882:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788844484.092900:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+11:7623:x1875739267841152:12345-0@lo:101: 00010000:00010000:0.0:1788844484.092909:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844484.092920:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d915b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.092937:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d915b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.092947:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d915b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.092954:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527400, rc 0) 00000100:00100000:0.0:1788844484.092987:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841152:12345-0@lo:101: Request processed in 88us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844484.092993:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788844484.093056:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841152:0@lo:101: 00010000:00010000:3.0:1788844484.093067:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.093075:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844484.093138:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841408:0@lo:501: 00000100:00100000:3.0:1788844484.093161:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.093187:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788844484.093229:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267841408 00000100:00100000:0.0:1788844484.093233:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267841408 00000100:00100000:0.0:1788844484.093247:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788844484.093253:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841408:12345-0@lo:501: 00000100:00100000:0.0:1788844484.093569:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841408:12345-0@lo:501: Request processed in 315us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844484.093576:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788844484.093818:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841408:0@lo:501: 00000100:00100000:3.0:1788844484.093843:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841536:0@lo:503: 00000100:00100000:3.0:1788844484.093877:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.093934:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788844484.093965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267841536 00000100:00100000:2.0:1788844484.093969:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267841536 00000100:00100000:2.0:1788844484.094024:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788844484.094032:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841536:12345-0@lo:503: 00000100:00100000:2.0:1788844484.094169:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841536:12345-0@lo:503: Request processed in 138us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.094176:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788844484.094233:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841536:0@lo:503: 00000040:00080000:3.0:1788844484.094474:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788844484.094530:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841664:0@lo:502: 00000100:00100000:3.0:1788844484.094580:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.094841:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788844484.094927:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267841664 00000100:00100000:0.0:1788844484.094932:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267841664 00000100:00100000:0.0:1788844484.094955:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788844484.094961:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841664:12345-0@lo:502: 00000100:00100000:0.0:1788844484.095095:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841664:12345-0@lo:502: Request processed in 134us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844484.095102:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788844484.095178:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841664:0@lo:502: 00000040:00080000:3.0:1788844484.095491:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788844484.095556:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788844484.095589:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788844484.095634:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788844484.095667:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788844484.095696:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788844484.095830:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841792:0@lo:502: 00000100:00100000:3.0:1788844484.095869:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.095883:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788844484.095952:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267841792 00000100:00100000:0.0:1788844484.095957:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267841792 00000100:00100000:0.0:1788844484.095976:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788844484.095982:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841792:12345-0@lo:502: 00000100:00100000:0.0:1788844484.096102:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841792:12345-0@lo:502: Request processed in 119us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844484.096109:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788844484.096194:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841792:0@lo:502: 00000040:00080000:3.0:1788844484.096272:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788844484.096280:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788844484.096870:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788844484.096877:0:7631:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788844484.096893:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844484.096896:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788844484.096901:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788844484.096915:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91eec2de99b8) 00000020:00000080:3.0:1788844484.096935:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788844484.096939:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788844484.097010:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eefacdc000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788844484.097017:0:7631:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788844484.097023:0:7631:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7f1093851e2d9170 00010000:00010000:3.0:1788844484.101106:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788844484.101462:0:7631:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788844484.104446:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788844484.104926:0:7631:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788844484.109325:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788844484.110161:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788844484.111337:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788844484.111350:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844484.111356:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844484.111359:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788844484.111362:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844484.111366:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844484.111385:0:7631:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788844484.111389:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788844484.111391:0:7631:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788844484.111435:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844484.111437:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844484.111439:0:7631:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788844484.111442:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788844484.111666:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788844484.111687:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788844484.111709:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.111789:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844484.111798:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eefacdc000 from 1 10000000:01000000:3.0:1788844484.111801:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788844484.111835:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.111845:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.111855:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844484.111877:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841920:0@lo:101: 00000100:00100000:3.0:1788844484.111958:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.111995:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788844484.113589:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267841920 00000100:00100000:1.0:1788844484.113603:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267841920 00000100:00100000:1.0:1788844484.113655:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788844484.113665:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:7623:x1875739267841920:12345-0@lo:101: 00010000:00010000:1.0:1788844484.113680:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844484.113696:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d917e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9177 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844484.113797:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d917e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9177 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844484.113810:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d917e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9177 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844484.113820:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bbe00, rc 0) 00000100:00100000:1.0:1788844484.113904:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267841920:12345-0@lo:101: Request processed in 241us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844484.113912:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788844484.114034:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267841920:0@lo:101: 00010000:00010000:3.0:1788844484.114052:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.114060:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844484.114204:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842048:0@lo:501: 00000100:00100000:3.0:1788844484.114236:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.114270:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788844484.114571:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267842048 00000100:00100000:1.0:1788844484.114577:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267842048 00000100:00100000:1.0:1788844484.114606:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788844484.114614:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267842048:12345-0@lo:501: 00000100:00100000:1.0:1788844484.114931:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267842048:12345-0@lo:501: Request processed in 317us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844484.114945:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788844484.115513:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842048:0@lo:501: 00000100:00100000:3.0:1788844484.115573:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842176:0@lo:503: 00000100:00100000:3.0:1788844484.115623:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.115650:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788844484.115667:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267842176 00000100:00100000:3.0:1788844484.115671:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267842176 00000100:00100000:3.0:1788844484.115696:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788844484.115703:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267842176:12345-0@lo:503: 00000100:00100000:3.0:1788844484.116127:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267842176:12345-0@lo:503: Request processed in 423us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844484.116135:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788844484.116569:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842176:0@lo:503: 00000040:00080000:1.0:1788844484.117943:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788844484.118014:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842304:0@lo:502: 00000100:00100000:1.0:1788844484.118075:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844484.118108:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed8217540 going to sleep for 11 seconds 00000100:00100000:2.0:1788844484.118205:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267842304 00000100:00100000:2.0:1788844484.118211:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267842304 00000100:00100000:2.0:1788844484.118289:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788844484.118297:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267842304:12345-0@lo:502: 00000100:00100000:2.0:1788844484.118506:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267842304:12345-0@lo:502: Request processed in 210us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.118513:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788844484.118609:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842304:0@lo:502: 00000040:00080000:1.0:1788844484.120707:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788844484.120802:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788844484.120841:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842432:0@lo:502: 00000100:00100000:1.0:1788844484.120921:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844484.121398:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed8217540 going to sleep for 11 seconds 00000100:00100000:0.0:1788844484.121511:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267842432 00000100:00100000:0.0:1788844484.121519:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267842432 00000100:00100000:0.0:1788844484.121581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788844484.121590:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267842432:12345-0@lo:502: 00000100:00100000:0.0:1788844484.122356:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267842432:12345-0@lo:502: Request processed in 765us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844484.122365:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788844484.122513:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842432:0@lo:502: 00000040:00080000:3.0:1788844484.122665:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788844484.122678:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788844484.123197:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844484.123207:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844484.123209:0:7635:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788844484.123215:0:7635:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eefacdc000 00000020:00000080:3.0:1788844484.123218:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788844484.123232:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844484.123235:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844484.123236:0:7635:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788844484.123238:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788844484.123351:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788844484.123370:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788844484.123455:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.123467:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844484.123514:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788844484.123517:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91eefacdc000 10000000:01000000:0.0:1788844484.123520:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91eefacdc000 10000000:01000000:0.0:1788844484.123523:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788844484.123529:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eefacdc000 from 1 10000000:01000000:0.0:1788844484.123531:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788844484.123586:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.123594:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.123604:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.123624:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842560:0@lo:101: 00000100:00100000:0.0:1788844484.123670:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844484.123704:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59ca000 going to sleep for 11 seconds 00000100:00100000:3.0:1788844484.123813:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267842560 00000100:00100000:3.0:1788844484.123820:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267842560 00000100:00100000:3.0:1788844484.123850:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788844484.123857:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267842560:12345-0@lo:101: 00010000:00010000:3.0:1788844484.123868:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844484.123880:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0025200/0x7f1093851e2d918c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9185 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.123914:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0025200/0x7f1093851e2d918c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9185 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.123924:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0025200/0x7f1093851e2d918c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9185 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.123933:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025200, rc 0) 00000100:00100000:3.0:1788844484.123963:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:7623:x1875739267842560:12345-0@lo:101: Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844484.123970:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788844484.124027:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842560:0@lo:101: 00010000:00010000:0.0:1788844484.124040:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.124049:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844484.124116:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842688:0@lo:501: 00000100:00100000:0.0:1788844484.124137:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844484.124195:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59ca000 going to sleep for 11 seconds 00000100:00100000:3.0:1788844484.126903:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267842688 00000100:00100000:3.0:1788844484.126919:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267842688 00000100:00100000:3.0:1788844484.126970:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788844484.126980:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:7623:x1875739267842688:12345-0@lo:501: 00000100:00100000:3.0:1788844484.127315:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:7623:x1875739267842688:12345-0@lo:501: Request processed in 336us (3175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844484.127323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788844484.127585:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842688:0@lo:501: 00000100:00100000:1.0:1788844484.127635:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842816:0@lo:503: 00000100:00100000:1.0:1788844484.127682:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844484.127713:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed8217c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788844484.127951:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267842816 00000100:00100000:3.0:1788844484.127957:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267842816 00000100:00100000:3.0:1788844484.127993:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788844484.128000:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:7623:x1875739267842816:12345-0@lo:503: 00000100:00100000:3.0:1788844484.128165:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:7623:x1875739267842816:12345-0@lo:503: Request processed in 165us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844484.128173:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788844484.128213:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842816:0@lo:503: 00000040:00080000:3.0:1788844484.128577:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788844484.128638:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842944:0@lo:502: 00000100:00100000:3.0:1788844484.128672:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.128692:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788844484.128753:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267842944 00000100:00100000:1.0:1788844484.128757:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267842944 00000100:00100000:1.0:1788844484.128783:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788844484.128789:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:7623:x1875739267842944:12345-0@lo:502: 00000100:00100000:1.0:1788844484.128948:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:7623:x1875739267842944:12345-0@lo:502: Request processed in 158us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844484.128954:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788844484.129072:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267842944:0@lo:502: 00000040:00080000:3.0:1788844484.129315:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788844484.129358:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788844484.129455:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788844484.129499:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788844484.129529:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788844484.129603:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788844484.129635:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788844484.129663:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788844484.129700:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788844484.129793:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788844484.129824:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788844484.129864:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788844484.129921:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788844484.129950:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788844484.129989:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788844484.130017:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788844484.130044:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788844484.130082:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788844484.130111:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788844484.130138:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788844484.130200:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788844484.130232:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788844484.130260:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788844484.130298:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788844484.130328:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788844484.130355:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788844484.131248:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788844484.131302:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788844484.131353:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788844484.131619:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788844484.131656:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788844484.131688:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788844484.131797:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788844484.131844:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788844484.131873:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788844484.131941:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788844484.131974:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788844484.132019:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267843072:0@lo:502: 00000100:00100000:3.0:1788844484.132093:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.132174:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788844484.132307:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267843072 00000100:00100000:1.0:1788844484.132314:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267843072 00000100:00100000:1.0:1788844484.132458:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788844484.132468:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:7623:x1875739267843072:12345-0@lo:502: 00000100:00100000:1.0:1788844484.132846:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:7623:x1875739267843072:12345-0@lo:502: Request processed in 378us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844484.132854:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788844484.132949:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267843072:0@lo:502: 00000040:00080000:0.0:1788844484.133039:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788844484.133050:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788844484.133614:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788844484.133628:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91eeff3eb370) 00000020:00000080:2.0:1788844484.133649:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788844484.133731:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eefacdc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788844484.133734:0:7636:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eefacdc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788844484.133737:0:7636:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eefacdc000 3 00010000:00080000:2.0:1788844484.133764:0:7636:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ef0166a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.143@tcp at head 00010000:00010000:2.0:1788844484.135257:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788844484.135430:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788844484.135460:0:7636:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788844484.135474:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7f1093851e2d919a 00000100:00080000:2.0:1788844484.135483:0:7636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788844484.135488:0:7636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91ef0166a000 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:2.0:1788844484.135521:0:7636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ef01673480 x1875739267843200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788844484.135587:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875739267843200:0@lo:38: 00000100:00100000:2.0:1788844484.135655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.135710:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267843200 00000100:00100000:2.0:1788844484.135716:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267843200 00000100:00100000:2.0:1788844484.135742:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788844484.135748:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1875739267843200:12345-0@lo:38: 00010000:00080000:2.0:1788844484.135769:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:2.0:1788844484.135811:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7f1093851e2d91a1 00000004:00100000:2.0:1788844484.135826:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788844484.135869:0:5839:0:(import.c:65:import_set_state_nolock()) ffff91eefb386800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788844484.135932:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875739267843200:12345-0@lo:38: Request processed in 183us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.135939:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788844484.135973:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ef01673480 x1875739267843200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788844494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844484.135983:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788844484.135990:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788844484.135995:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788844484.135999:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788844484.136001:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91ef0166a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788844484.136006:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875739267843200:0@lo:38: 00000100:00080000:2.0:1788844484.136029:0:7636:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788844484.136097:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267843328:0@lo:400: 00000100:00100000:2.0:1788844484.136119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.136146:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267843456:0@lo:400: 00000100:00100000:2.0:1788844484.136165:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.136178:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844484.136182:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267843584:0@lo:400: 00000100:00100000:2.0:1788844484.136201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.136224:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267843328 00000100:00100000:2.0:1788844484.136227:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267843328 00000100:00100000:2.0:1788844484.136248:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267843456 00000100:00100000:2.0:1788844484.136250:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267843456 00000100:00100000:2.0:1788844484.136269:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788844484.136274:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267843328:12345-0@lo:400: 00000100:00100000:2.0:1788844484.136305:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267843328:12345-0@lo:400: Request processed in 31us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.136311:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788844484.136321:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788844484.145949:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267843456:12345-0@lo:400: 00000100:00100000:2.0:1788844484.146056:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267843456:12345-0@lo:400: Request processed in 9729us (9888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.146065:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788844484.146126:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267843584 00000100:00100000:2.0:1788844484.146135:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267843584 00000100:00100000:2.0:1788844484.146189:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788844484.146198:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267843584:12345-0@lo:400: 00000100:00100000:2.0:1788844484.146232:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267843584:12345-0@lo:400: Request processed in 36us (10030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.146247:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788844484.146268:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788844484.146272:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788844484.147220:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ef01673480 x1875739267843328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844484.147237:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267843328:0@lo:400: 00010000:00080000:2.0:1788844484.147282:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ef01671180 x1875739267843584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844484.147291:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267843584:0@lo:400: 00010000:00080000:2.0:1788844484.147302:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ef01672d80 x1875739267843456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844484.147309:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267843456:0@lo:400: 00000040:00080000:2.0:1788844484.148224:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788844484.148837:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788844484.148865:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788844484.148895:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844484.148908:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788844484.148955:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788844484.148957:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788844484.148959:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844484.148960:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844484.148961:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844484.148962:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844484.148963:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788844484.148965:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788844484.148966:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788844484.148967:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844484.148969:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788844484.148972:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788844484.148975:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788844484.148976:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788844484.148978:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844484.148979:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844484.148980:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844484.148981:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844484.148982:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788844484.148983:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788844484.148984:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788844484.148985:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844484.148986:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788844484.149010:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788844484.149028:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267843712:0@lo:253: 00000100:00100000:0.0:1788844484.149092:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844484.149135:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1788844484.149943:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267843712 00000100:00100000:0.0:1788844484.149957:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267843712 00000100:00100000:0.0:1788844484.150005:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788844484.150013:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:7623:x1875739267843712:12345-0@lo:253: 20000000:01000000:0.0:1788844484.150045:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788844484.150060:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788844484.158633:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1875739267843840:0@lo:901: 00000100:00100000:1.0:1788844484.158705:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844484.158940:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed8217e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788844484.162854:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267843840 00000100:00100000:3.0:1788844484.162868:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267843840 00000100:00100000:3.0:1788844484.162946:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788844484.162955:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1875739267843840:12345-0@lo:901: 00000100:00100000:3.0:1788844484.163405:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1875739267843840:12345-0@lo:901: Request processed in 450us (4698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844484.163413:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788844484.163440:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788844484.167686:0:7638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91eefb6d5f80 x1875739267843840/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788844500 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844484.167706:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1875739267843840:0@lo:901: 20000000:01000000:0.0:1788844484.202256:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788844484.202274:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788844484.203450:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788844484.203458:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788844484.203484:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.203515:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5526800/0x7f1093851e2d90f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d90f2 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.203524:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.203594:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5526800/0x7f1093851e2d90f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d90f2 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.203611:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5526800/0x7f1093851e2d90f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d90f2 expref: 14 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844484.203626:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875739267843968:0@lo:104: 00000100:00100000:3.0:1788844484.203694:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844484.203743:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788844484.203815:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267843968 00000100:00100000:2.0:1788844484.203823:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267843968 00000100:00100000:2.0:1788844484.203875:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788844484.203893:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:5854:x1875739267843968:12345-0@lo:104: 00010000:00010000:2.0:1788844484.203906:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.203957:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788844484.203963:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:5854:x1875739267843968:12345-0@lo:104: Request processed in 80us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.203969:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788844484.203990:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844484.204002:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204010:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024600 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844484.204014:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204022:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844484.204030:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844484.204036:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788844484.204064:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204070:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844484.204085:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204091:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d90f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204105:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844484.204106:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844484.204108:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844484.204125:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267844096:0@lo:103: 00000100:00100000:2.0:1788844484.204156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844484.204187:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267844096 00000100:00100000:2.0:1788844484.204190:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267844096 00010000:00010000:2.0:1788844484.204213:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5526800/0x7f1093851e2d90f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d90f2 expref: 15 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844484.204232:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788844484.204238:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:3305:x1875739267844096:12345-0@lo:103: 00010000:00010000:2.0:1788844484.204248:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844484.204253:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5526800/0x7f1093851e2d90f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d90f2 expref: 15 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204262:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5526800/0x7f1093851e2d90f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d90f2 expref: 15 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204291:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204299:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788844484.204311:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005123070s 00010000:00010000:2.0:1788844484.204315:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204322:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204329:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204334:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204340:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844484.204352:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204360:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204369:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844484.204378:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844484.204403:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:3305:x1875739267844096:12345-0@lo:103: Request processed in 165us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.204409:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788844484.204463:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267844096:0@lo:103: 00010000:00010000:3.0:1788844484.204660:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526800/0x7f1093851e2d90f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d90f2 expref: 14 pid: 5833 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844484.204670:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875739267843968:0@lo:104: 00010000:00010000:3.0:1788844484.204680:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.204689:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.204695:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844484.204701:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844484.232948:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:7623:x1875739267843712:12345-0@lo:253: Request processed in 82925us (83845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844484.232964:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788844484.233068:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:7623:1875739267843712:0@lo:253: 10000000:01000000:0.0:1788844484.233085:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788844484.233088:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788844484.233090:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788844484.233091:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844484.233092:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844484.233093:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844484.233095:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844484.233096:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788844484.233098:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788844484.233099:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788844484.233101:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844484.233102:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788844484.233114:0:7623:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788844484.240416:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788844484.240845:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788844484.241067:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788844484.241228:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788844484.241387:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788844484.243141:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788844484.245842:0:7623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788844484.497104:0:7623:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788844484.497112:0:7623:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788844484.497154:0:7623:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788844484.497214:0:7623:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788844484.497228:0:7623:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788844484.497255:0:7623:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788844484.794460:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844484.857744:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267844224:0@lo:13: 00000100:00100000:0.0:1788844484.857842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844484.857930:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267844224 00000100:00100000:0.0:1788844484.857937:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267844224 00000100:00100000:0.0:1788844484.857988:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788844484.858006:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267844224:12345-0@lo:13: 00002000:00000024:0.0:1788844484.858039:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844484.858081:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267844224:12345-0@lo:13: Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844484.858088:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788844484.858136:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d6a00 x1875739267844224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844484.858158:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267844224:0@lo:13: 00010000:00010000:0.0:1788844485.822756:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844486.842980:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844487.874568:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844488.890108:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844489.475216:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788844489.475270:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844489.475292:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267844480:0@lo:400: 00000100:00100000:2.0:1788844489.475355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844489.475411:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267844480 00000100:00100000:2.0:1788844489.475418:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267844480 00000100:00100000:2.0:1788844489.475460:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788844489.475467:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267844480:12345-0@lo:400: 00000100:00100000:2.0:1788844489.475512:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267844480:12345-0@lo:400: Request processed in 45us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844489.475518:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788844489.475582:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d5880 x1875739267844480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844489.475596:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267844480:0@lo:400: 00000100:00100000:3.0:1788844489.482999:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267844352:0@lo:400: 00000100:00100000:3.0:1788844489.483159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844489.483288:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267844352 00000100:00100000:2.0:1788844489.483298:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267844352 00000100:00100000:2.0:1788844489.483396:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788844489.483405:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:3308:x1875739267844352:12345-0@lo:400: 00000100:00100000:2.0:1788844489.483464:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:3308:x1875739267844352:12345-0@lo:400: Request processed in 60us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844489.483472:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788844489.485066:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267844864:0@lo:400: 00000100:00100000:1.0:1788844489.485122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844489.485166:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267844608:0@lo:400: 00000100:00100000:1.0:1788844489.485187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844489.485204:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844489.485210:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267844736:0@lo:400: 00000100:00100000:1.0:1788844489.485233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844489.485262:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267844864 00000100:00100000:1.0:1788844489.485269:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267844864 00000100:00100000:1.0:1788844489.485313:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267844608 00000100:00100000:1.0:1788844489.485317:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267844608 00000100:00100000:1.0:1788844489.485335:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788844489.485342:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267844864:12345-0@lo:400: 00000100:00100000:1.0:1788844489.485388:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267844864:12345-0@lo:400: Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844489.485395:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788844489.485410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788844489.485417:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267844608:12345-0@lo:400: 00000100:00100000:1.0:1788844489.485447:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267844608:12345-0@lo:400: Request processed in 30us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844489.485460:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788844489.485483:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267844736 00000100:00100000:1.0:1788844489.485486:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267844736 00000100:00100000:1.0:1788844489.485513:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788844489.485519:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267844736:12345-0@lo:400: 00000100:00100000:1.0:1788844489.485566:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267844736:12345-0@lo:400: Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844489.485573:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788844489.485589:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788844489.485593:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788844489.485625:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d5880 x1875739267844736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844489.485638:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267844736:0@lo:400: 00010000:00080000:1.0:1788844489.485649:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d6300 x1875739267844608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844489.485657:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267844608:0@lo:400: 00010000:00080000:1.0:1788844489.485701:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d6a00 x1875739267844864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844489.485710:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267844864:0@lo:400: 00000100:00100000:3.0:1788844489.490857:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267844352:0@lo:400: 00010000:00010000:0.0:1788844489.914153:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844489.978482:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788844489.978508:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267844992:0@lo:13: 00000100:00100000:1.0:1788844489.978745:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844489.978831:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267844992 00000100:00100000:1.0:1788844489.978838:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267844992 00000100:00100000:1.0:1788844489.978884:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788844489.978904:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267844992:12345-0@lo:13: 00002000:00000024:1.0:1788844489.979160:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844489.979207:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267844992:12345-0@lo:13: Request processed in 305us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844489.979215:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788844489.979255:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d6a00 x1875739267844992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844489.979275:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267844992:0@lo:13: 00010000:00010000:0.0:1788844490.942618:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788844491.842417:0:7979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788844491.964434:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844492.986498:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844494.015382:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788844494.073676:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788844494.073687:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eef3110000 from 30 10000000:01000000:2.0:1788844494.073703:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788844494.073750:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.073763:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.073776:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844494.073808:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01671c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267845120:0@lo:101: 00000100:00100000:2.0:1788844494.073896:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.073965:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.074565:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267845120 00000100:00100000:3.0:1788844494.074575:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267845120 00000100:00100000:3.0:1788844494.074629:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788844494.074639:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267845120:12345-0@lo:101: 00010000:00010000:3.0:1788844494.074653:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844494.074668:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d91af expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.074706:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d91af expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.074719:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d91af expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.074728:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025600, rc 0) 00000100:00100000:3.0:1788844494.074782:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267845120:12345-0@lo:101: Request processed in 144us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.074789:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788844494.074952:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01671c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267845120:0@lo:101: 00010000:00010000:1.0:1788844494.074981:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844494.074990:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844494.075073:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267845248:0@lo:501: 00000100:00100000:1.0:1788844494.075105:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844494.075137:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532780 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.075644:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267845248 00000100:00100000:3.0:1788844494.075652:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267845248 00000100:00100000:3.0:1788844494.075700:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788844494.075709:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267845248:12345-0@lo:501: 00000100:00100000:3.0:1788844494.076394:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267845248:12345-0@lo:501: Request processed in 684us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.076404:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788844494.076452:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267845248:0@lo:501: 00000100:00100000:3.0:1788844494.076495:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267845376:0@lo:503: 00000100:00100000:3.0:1788844494.076561:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844494.076586:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67840 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.076598:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267845376 00000100:00100000:3.0:1788844494.076602:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267845376 00000100:00100000:3.0:1788844494.076622:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788844494.076629:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267845376:12345-0@lo:503: 00000100:00100000:3.0:1788844494.076955:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267845376:12345-0@lo:503: Request processed in 325us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.076962:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788844494.080141:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267845376:0@lo:503: 00000100:00100000:2.0:1788844494.080680:0:8081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8081:1875739267845504:0@lo:502: 00000100:00100000:2.0:1788844494.080779:0:8081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.080838:0:8081:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.080952:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267845504 00000100:00100000:3.0:1788844494.080960:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267845504 00000100:00100000:3.0:1788844494.081164:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788844494.081174:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:8081:x1875739267845504:12345-0@lo:502: 00000100:00100000:3.0:1788844494.081963:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:8081:x1875739267845504:12345-0@lo:502: Request processed in 786us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.081982:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788844494.089123:0:8081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8081:1875739267845504:0@lo:502: 00000100:00100000:3.0:1788844494.089324:0:8081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8081:1875739267845632:0@lo:502: 00000100:00100000:3.0:1788844494.089424:0:8081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844494.089478:0:8081:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67900 going to sleep for 11 seconds 00000100:00100000:2.0:1788844494.090119:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267845632 00000100:00100000:2.0:1788844494.090130:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267845632 00000100:00100000:2.0:1788844494.090195:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788844494.090205:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:8081:x1875739267845632:12345-0@lo:502: 00000100:00100000:2.0:1788844494.090564:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:8081:x1875739267845632:12345-0@lo:502: Request processed in 358us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844494.090574:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788844494.090860:0:8081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8081:1875739267845632:0@lo:502: 00000040:00080000:3.0:1788844494.090896:0:8081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788844494.091314:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788844494.091349:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788844494.091362:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.091374:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844494.091387:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788844494.091391:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788844494.091395:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788844494.091435:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.091444:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.091456:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844494.091490:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267845760:0@lo:101: 00000100:00100000:2.0:1788844494.092334:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.092381:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.092474:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267845760 00000100:00100000:3.0:1788844494.092483:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267845760 00000100:00100000:3.0:1788844494.092555:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788844494.092565:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267845760:12345-0@lo:101: 00010000:00010000:3.0:1788844494.092578:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844494.092591:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0024000/0x7f1093851e2d91c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d91bd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.092617:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024000/0x7f1093851e2d91c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d91bd expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.092630:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0024000/0x7f1093851e2d91c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d91bd expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.092640:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:3.0:1788844494.092708:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267845760:12345-0@lo:101: Request processed in 143us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.092714:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788844494.092830:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267845760:0@lo:101: 00010000:00010000:1.0:1788844494.092847:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844494.092857:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844494.092930:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267845888:0@lo:501: 00000100:00100000:1.0:1788844494.092961:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844494.092998:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532840 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.094662:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267845888 00000100:00100000:3.0:1788844494.094676:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267845888 00000100:00100000:3.0:1788844494.094737:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788844494.094746:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267845888:12345-0@lo:501: 00000100:00100000:3.0:1788844494.096807:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267845888:12345-0@lo:501: Request processed in 2055us (3837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.096840:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788844494.098061:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267845888:0@lo:501: 00000100:00100000:2.0:1788844494.098126:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267846016:0@lo:503: 00000100:00100000:2.0:1788844494.098287:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.098340:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.098412:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267846016 00000100:00100000:3.0:1788844494.098420:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267846016 00000100:00100000:3.0:1788844494.099794:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788844494.099813:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267846016:12345-0@lo:503: 00000100:00100000:3.0:1788844494.100478:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267846016:12345-0@lo:503: Request processed in 670us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.100487:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788844494.103281:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267846016:0@lo:503: 00000100:00100000:2.0:1788844494.106319:0:8083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8083:1875739267846144:0@lo:502: 00000100:00100000:2.0:1788844494.106413:0:8083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.106517:0:8083:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1788844494.108325:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267846144 00000100:00100000:1.0:1788844494.108343:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267846144 00000100:00100000:1.0:1788844494.108416:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788844494.108443:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:8083:x1875739267846144:12345-0@lo:502: 00000100:00100000:0.0:1788844494.108953:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:8083:x1875739267846144:12345-0@lo:502: Request processed in 525us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844494.108962:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788844494.109060:0:8083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8083:1875739267846144:0@lo:502: 00000020:01000000:2.0:1788844494.109097:0:8083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788844494.109106:0:8083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844494.109109:0:8083:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788844494.109114:0:8083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788844494.109116:0:8083:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788844494.109148:0:8083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8083:1875739267846272:0@lo:502: 00000100:00100000:2.0:1788844494.109207:0:8083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.109247:0:8083:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788844494.109420:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267846272 00000100:00100000:0.0:1788844494.109425:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267846272 00000100:00100000:0.0:1788844494.109480:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788844494.109487:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:8083:x1875739267846272:12345-0@lo:502: 00000100:00100000:0.0:1788844494.109655:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:8083:x1875739267846272:12345-0@lo:502: Request processed in 168us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844494.109663:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788844494.109731:0:8083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8083:1875739267846272:0@lo:502: 00000020:01000000:1.0:1788844494.109750:0:8083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844494.109755:0:8083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844494.109757:0:8083:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788844494.109761:0:8083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788844494.111754:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788844494.111792:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788844494.111805:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.111835:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844494.112042:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788844494.112047:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eed0c68800 from 30 10000000:01000000:3.0:1788844494.112051:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788844494.112097:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.112105:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.112116:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844494.112141:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267846400:0@lo:101: 00000100:00100000:3.0:1788844494.112293:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844494.112380:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67000 going to sleep for 11 seconds 00000100:00100000:0.0:1788844494.112420:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267846400 00000100:00100000:0.0:1788844494.112429:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267846400 00000100:00100000:0.0:1788844494.112652:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788844494.112662:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267846400:12345-0@lo:101: 00010000:00010000:0.0:1788844494.112674:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844494.112687:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5527c00/0x7f1093851e2d91d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d91cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844494.112721:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5527c00/0x7f1093851e2d91d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d91cb expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844494.112731:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5527c00/0x7f1093851e2d91d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d91cb expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844494.112740:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527c00, rc 0) 00000100:00100000:0.0:1788844494.112792:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267846400:12345-0@lo:101: Request processed in 132us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844494.112800:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788844494.112849:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267846400:0@lo:101: 00010000:00010000:1.0:1788844494.112865:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844494.112874:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844494.112934:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267846528:0@lo:501: 00000100:00100000:1.0:1788844494.112964:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844494.113026:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267846528 00000100:00100000:0.0:1788844494.113031:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267846528 00000100:00100000:1.0:1788844494.113037:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532840 going to sleep for 11 seconds 00000100:00100000:0.0:1788844494.113089:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788844494.113097:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267846528:12345-0@lo:501: 00000100:00100000:0.0:1788844494.113369:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267846528:12345-0@lo:501: Request processed in 272us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844494.113383:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788844494.115448:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267846528:0@lo:501: 00000100:00100000:1.0:1788844494.115508:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267846656:0@lo:503: 00000100:00100000:1.0:1788844494.115593:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844494.115638:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532840 going to sleep for 11 seconds 00000100:00100000:0.0:1788844494.115787:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267846656 00000100:00100000:0.0:1788844494.115794:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267846656 00000100:00100000:0.0:1788844494.116067:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788844494.116081:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267846656:12345-0@lo:503: 00000100:00100000:0.0:1788844494.116316:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267846656:12345-0@lo:503: Request processed in 237us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844494.116323:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788844494.116403:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267846656:0@lo:503: 00000100:00100000:2.0:1788844494.117508:0:8085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01670000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8085:1875739267846784:0@lo:502: 00000100:00100000:0.0:1788844494.122951:0:8085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844494.123228:0:8085:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.123494:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267846784 00000100:00100000:3.0:1788844494.123504:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267846784 00000100:00100000:3.0:1788844494.123758:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788844494.123769:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:8085:x1875739267846784:12345-0@lo:502: 00000100:00100000:3.0:1788844494.124119:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:8085:x1875739267846784:12345-0@lo:502: Request processed in 351us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.124127:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788844494.124224:0:8085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01670000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8085:1875739267846784:0@lo:502: 00000100:00100000:0.0:1788844494.124290:0:8085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8085:1875739267846912:0@lo:502: 00000100:00100000:0.0:1788844494.124333:0:8085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844494.125018:0:8085:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788844494.125156:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267846912 00000100:00100000:1.0:1788844494.125164:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267846912 00000100:00100000:3.0:1788844494.125277:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788844494.125288:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:8085:x1875739267846912:12345-0@lo:502: 00000100:00100000:3.0:1788844494.125558:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:8085:x1875739267846912:12345-0@lo:502: Request processed in 272us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.125566:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788844494.126476:0:8085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8085:1875739267846912:0@lo:502: 00000040:00080000:0.0:1788844494.126518:0:8085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788844494.127012:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788844494.127042:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788844494.127066:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.127078:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844494.127090:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788844494.127093:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eed0c68800 from 5 10000000:01000000:2.0:1788844494.127096:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788844494.127148:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.127156:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.127165:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844494.127384:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267847040:0@lo:101: 00000100:00100000:2.0:1788844494.127467:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.127515:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788844494.127729:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267847040 00000100:00100000:0.0:1788844494.127736:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267847040 00000100:00100000:0.0:1788844494.127773:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788844494.127781:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267847040:12345-0@lo:101: 00010000:00010000:0.0:1788844494.127803:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844494.127816:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5527800/0x7f1093851e2d91e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d91d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844494.127839:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5527800/0x7f1093851e2d91e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d91d9 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844494.127867:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5527800/0x7f1093851e2d91e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d91d9 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844494.127877:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527800, rc 0) 00000100:00100000:0.0:1788844494.127917:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267847040:12345-0@lo:101: Request processed in 135us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844494.127923:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788844494.131900:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267847040:0@lo:101: 00010000:00010000:2.0:1788844494.131957:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.131984:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844494.132378:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267847168:0@lo:256: 00000100:00100000:2.0:1788844494.132455:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.132571:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.132734:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267847168 00000100:00100000:3.0:1788844494.132744:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267847168 00000100:00100000:3.0:1788844494.132809:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788844494.132821:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267847168:12345-0@lo:256: 20000000:01000000:3.0:1788844494.132847:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788844494.132867:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788844494.132871:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788844494.132958:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267847168:12345-0@lo:256: Request processed in 139us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.132966:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788844494.133085:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267847168:0@lo:256: 10000000:01000000:2.0:1788844494.133148:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788844494.133156:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.133165:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844494.133176:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788844494.133315:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788844494.133319:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788844494.133352:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.133361:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.133369:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844494.133392:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267847296:0@lo:101: 00000100:00100000:2.0:1788844494.133422:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.133440:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.133591:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267847296 00000100:00100000:3.0:1788844494.133596:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267847296 00000100:00100000:3.0:1788844494.133616:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788844494.133622:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267847296:12345-0@lo:101: 00010000:00010000:3.0:1788844494.133631:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844494.133645:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0025800/0x7f1093851e2d91ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d91e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.133666:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0025800/0x7f1093851e2d91ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d91e7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.133684:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0025800/0x7f1093851e2d91ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d91e7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844494.133704:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844494.133734:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267847296:12345-0@lo:101: Request processed in 112us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.133740:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788844494.134296:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267847296:0@lo:101: 00010000:00010000:2.0:1788844494.134311:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.134319:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844494.134374:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267847424:0@lo:501: 00000100:00100000:2.0:1788844494.134406:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.134439:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.135416:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267847424 00000100:00100000:3.0:1788844494.135425:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267847424 00000100:00100000:3.0:1788844494.135474:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788844494.135483:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267847424:12345-0@lo:501: 00000100:00100000:3.0:1788844494.135863:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267847424:12345-0@lo:501: Request processed in 380us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.135872:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788844494.136135:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267847424:0@lo:501: 00000100:00100000:2.0:1788844494.136364:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267847552:0@lo:503: 00000100:00100000:2.0:1788844494.136415:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.136439:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.136651:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267847552 00000100:00100000:3.0:1788844494.136657:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267847552 00000100:00100000:3.0:1788844494.136707:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788844494.136714:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267847552:12345-0@lo:503: 00000100:00100000:3.0:1788844494.137429:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267847552:12345-0@lo:503: Request processed in 712us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.137438:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788844494.137622:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267847552:0@lo:503: 00000100:00100000:3.0:1788844494.139670:0:8086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8086:1875739267847680:0@lo:502: 00000100:00100000:3.0:1788844494.139812:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844494.139908:0:8086:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4d136c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844494.140492:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267847680 00000100:00100000:2.0:1788844494.140500:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267847680 00000100:00100000:2.0:1788844494.140957:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788844494.140969:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8086:x1875739267847680:12345-0@lo:502: 00000100:00100000:2.0:1788844494.141495:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8086:x1875739267847680:12345-0@lo:502: Request processed in 527us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844494.141515:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788844494.141659:0:8086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8086:1875739267847680:0@lo:502: 00000020:01000000:0.0:1788844494.141705:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788844494.141721:0:8086:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788844494.141729:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844494.141731:0:8086:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788844494.141736:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788844494.141741:0:8086:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.143@tcp to nid 0x20000c0a8cc8f (192.168.204.143@tcp) 00000020:01000000:0.0:1788844494.141764:0:8086:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788844494.141767:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788844494.141781:0:8086:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91eef910cd28) 00000020:00000080:0.0:1788844494.141811:0:8086:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788844494.141817:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788844494.141923:0:8086:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788844494.141930:0:8086:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788844494.141938:0:8086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2d91fc 00010000:00080000:0.0:1788844494.141979:0:8086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eec71b0800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:0.0:1788844494.142525:0:8086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788844494.144479:0:8086:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788844494.144500:0:8086:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788844494.152532:0:8086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788844494.157561:0:8086:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788844494.157655:0:8086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788844494.157741:0:8086:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788844494.166603:0:8087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788844494.166613:0:8087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788844494.173871:0:8086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788844494.173888:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788844494.173929:0:8086:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788844494.173953:0:8086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7f1093851e2d9203 00000100:00080000:0.0:1788844494.173964:0:8086:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788844494.173970:0:8086:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eec71b0800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:0.0:1788844494.174009:0:8086:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eec6aef480 x1875739267847808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788844494.174042:0:8086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788844494.174113:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788844494.174117:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844494.174119:0:8086:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788844494.174123:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788844494.174127:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844494.174129:0:8086:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788844494.174132:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788844494.174133:0:8086:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788844494.174165:0:8086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8086:1875739267847936:0@lo:502: 00000100:00100000:0.0:1788844494.174268:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844494.174305:0:8086:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.174558:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267848192:0@lo:400: 00000100:00100000:3.0:1788844494.174594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844494.174629:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788844494.174636:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267848064:0@lo:400: 00000100:00100000:3.0:1788844494.174660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844494.174684:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267848448:0@lo:400: 00000100:00100000:3.0:1788844494.174721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844494.174739:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844494.174744:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267848320:0@lo:400: 00000100:00100000:3.0:1788844494.174780:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844494.174811:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267848192 00000100:00100000:3.0:1788844494.174817:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267848192 00000100:00100000:3.0:1788844494.174859:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267848064 00000100:00100000:3.0:1788844494.174863:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267848064 00000100:00100000:3.0:1788844494.174874:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267848448 00000100:00100000:3.0:1788844494.174876:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267848448 00000100:00100000:3.0:1788844494.174893:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788844494.174902:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267848192:12345-0@lo:400: 00000100:00100000:3.0:1788844494.174957:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267848192:12345-0@lo:400: Request processed in 55us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.174968:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788844494.174983:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788844494.174989:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267848064:12345-0@lo:400: 00000100:00100000:3.0:1788844494.175017:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267848064:12345-0@lo:400: Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.175022:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788844494.175033:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788844494.175039:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267848448:12345-0@lo:400: 00000100:00100000:3.0:1788844494.175069:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267848448:12345-0@lo:400: Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.175082:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788844494.175109:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267848320 00000100:00100000:3.0:1788844494.175113:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267848320 00000100:00100000:3.0:1788844494.175141:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788844494.175148:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267848320:12345-0@lo:400: 00000100:00100000:3.0:1788844494.175192:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267848320:12345-0@lo:400: Request processed in 33us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.175199:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788844494.175216:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788844494.175220:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788844494.175248:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8568000 x1875739267848320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844494.175262:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267848320:0@lo:400: 00010000:00080000:3.0:1788844494.175273:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8569f80 x1875739267848448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844494.175281:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267848448:0@lo:400: 00010000:00080000:3.0:1788844494.175310:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8568e00 x1875739267848064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844494.175319:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267848064:0@lo:400: 00010000:00080000:3.0:1788844494.175328:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed856b800 x1875739267848192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844494.175335:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267848192:0@lo:400: 00000100:00100000:1.0:1788844494.175589:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267847936 00000100:00100000:1.0:1788844494.175595:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267847936 00000100:00100000:1.0:1788844494.175633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788844494.175641:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8086:x1875739267847936:12345-0@lo:502: 00000100:00100000:1.0:1788844494.175903:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8086:x1875739267847936:12345-0@lo:502: Request processed in 263us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844494.175912:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788844494.176045:0:8086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8086:1875739267847936:0@lo:502: 00000020:01000000:0.0:1788844494.176082:0:8086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788844494.176088:0:8086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844494.176090:0:8086:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788844494.176094:0:8086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1788844494.176526:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267847808:0@lo:8: 00000100:00100000:2.0:1788844494.176611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788844494.176658:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788844494.176681:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788844494.176701:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.176712:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844494.176722:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788844494.176724:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91eed850cd28 from 1 10000000:01000000:2.0:1788844494.176727:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788844494.176756:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.176763:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.176771:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844494.176786:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267848576:0@lo:101: 00000100:00100000:2.0:1788844494.176815:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.176828:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788844494.176912:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267848576 00000100:00100000:0.0:1788844494.176926:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267848576 00000100:00100000:0.0:1788844494.176962:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788844494.176969:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267848576:12345-0@lo:101: 00010000:00010000:0.0:1788844494.176979:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844494.176992:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5526800/0x7f1093851e2d9211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d920a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844494.177015:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526800/0x7f1093851e2d9211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d920a expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844494.177026:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5526800/0x7f1093851e2d9211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d920a expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844494.177036:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526800, rc 0) 00000100:00100000:0.0:1788844494.177154:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267848576:12345-0@lo:101: Request processed in 185us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844494.177161:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788844494.177666:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267847808 00000100:00100000:1.0:1788844494.177673:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267847808 00000100:00100000:1.0:1788844494.177708:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788844494.177714:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875739267847808:12345-0@lo:8: 00010000:00080000:1.0:1788844494.177739:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:1.0:1788844494.177773:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7f1093851e2d9218 00002000:00100000:1.0:1788844494.177789:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91eec5754800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788844494.177795:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788844494.177798:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788844494.177936:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788844494.179468:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267848576:0@lo:101: 00010000:00010000:2.0:1788844494.179495:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844494.179522:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844494.179642:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267848704:0@lo:501: 00000100:00100000:2.0:1788844494.179710:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.179744:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788844494.179805:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267848704 00000100:00100000:1.0:1788844494.179811:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267848704 00000100:00100000:1.0:1788844494.179859:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788844494.179869:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267848704:12345-0@lo:501: 00002000:00080000:0.0:1788844494.180236:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788844494.180272:0:6686:0:(import.c:65:import_set_state_nolock()) ffff91eec71b6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844494.180332:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875739267847808:12345-0@lo:8: Request processed in 2616us (3720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844494.180341:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788844494.180531:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aef480 x1875739267847808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788844504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844494.180584:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788844494.180594:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788844494.180602:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788844494.180608:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788844494.180610:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec71b0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788844494.180625:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788844494.180631:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267847808:0@lo:8: 00000004:00080000:0.0:1788844494.181431:0:8087:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788844494.181557:0:8087:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 208460019513ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788844494.181895:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267848704:12345-0@lo:501: Request processed in 2025us (2181us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788844494.181907:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788844494.198349:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267848704:0@lo:501: 10000000:01000000:1.0:1788844494.198402:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788844494.198414:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844494.198463:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788844494.285859:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788844494.286468:0:8088:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788844494.286513:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875739267848960:0@lo:7: 00000100:00100000:1.0:1788844494.286619:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844494.286661:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267848960 00000100:00100000:1.0:1788844494.286669:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267848960 00000100:00100000:1.0:1788844494.286745:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788844494.286755:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8088:x1875739267848960:12345-0@lo:7: 00000100:00100000:2.0:1788844494.287288:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788844494.287305:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267848832:0@lo:13: 00000100:00100000:2.0:1788844494.287346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.287417:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267848832 00000100:00100000:2.0:1788844494.287423:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267848832 00000100:00100000:2.0:1788844494.287454:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844494.287461:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875739267848832:12345-0@lo:13: 00002000:00000024:2.0:1788844494.287486:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788844494.287529:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875739267848832:12345-0@lo:13: Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844494.287559:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788844494.287600:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d5c00 x1875739267848832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844494.287621:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267848832:0@lo:13: 00000100:00080000:0.0:1788844494.289570:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788844494.289596:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532480 going to sleep for 11 seconds 00002000:00080000:0.0:1788844494.321828:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788844494.321840:0:6688:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788844494.321964:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8088:x1875739267848960:12345-0@lo:7: Request processed in 35205us (35340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844494.321989:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788844494.322459:0:8088:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d4380 x1875739267848960/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788844510 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844494.322497:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875739267848960:0@lo:7: 00000004:00080000:2.0:1788844494.322513:0:8088:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788844494.322579:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01672300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875739267849088:0@lo:5: 00000100:00100000:2.0:1788844494.322620:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844494.322780:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267849088 00000100:00100000:3.0:1788844494.322789:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267849088 00000100:00100000:2.0:1788844494.323191:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.328815:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788844494.328844:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8088:x1875739267849088:12345-0@lo:5: 00002000:00080000:3.0:1788844494.328886:0:7066:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788844494.328891:0:7066:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788844494.330438:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8088:x1875739267849088:12345-0@lo:5: Request processed in 1214us (7422us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788844494.330455:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788844494.330697:0:8088:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ef01672300 x1875739267849088/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788844510 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844494.330730:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01672300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875739267849088:0@lo:5: 00000004:00080000:2.0:1788844494.330745:0:8088:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788844494.330789:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01670380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875739267849216:0@lo:700: 00000100:00100000:2.0:1788844494.330833:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844494.330870:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788844494.331343:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267849216 00000100:00100000:3.0:1788844494.331352:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267849216 00000100:00100000:3.0:1788844494.331404:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788844494.331412:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8088:x1875739267849216:12345-0@lo:700: 00000100:00100000:3.0:1788844494.331455:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1875739267849344:0@lo:700: 00000100:00100000:3.0:1788844494.331582:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844494.331610:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eefb137900 going to sleep for 11 seconds 00000100:00100000:0.0:1788844494.331674:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267849344 00000100:00100000:0.0:1788844494.331679:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267849344 00000100:00100000:0.0:1788844494.331734:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788844494.331743:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1875739267849344:12345-0@lo:700: 40000000:02000000:0.0:1788844494.416150:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788844494.428516:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1875739267849344:12345-0@lo:700: Request processed in 96765us (96924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844494.428560:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788844494.431648:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed84d6300 x1875739267849344/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788844510 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844494.431668:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1875739267849344:0@lo:700: 40000000:02000000:3.0:1788844494.432133:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1788844494.590746:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8088:x1875739267849216:12345-0@lo:700: Request processed in 259325us (259903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844494.590761:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788844494.590944:0:8088:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ef01670380 x1875739267849216/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788844510 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844494.590963:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01670380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875739267849216:0@lo:700: 00000001:00100000:2.0:1788844494.592700:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788844494.592731:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:1.0:1788844494.637275:0:8088:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788844494.642849:0:8088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875739267849472:0@lo:5: 00000100:00100000:1.0:1788844494.642921:0:8088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844494.643218:0:8088:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed0389240 going to sleep for 11 seconds 00000100:00100000:2.0:1788844494.643422:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267849472 00000100:00100000:2.0:1788844494.643431:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267849472 00000100:00100000:2.0:1788844494.643566:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788844494.643578:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8088:x1875739267849472:12345-0@lo:5: 00002000:00080000:3.0:1788844494.649757:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788844494.649778:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788844494.654395:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8088:x1875739267849472:12345-0@lo:5: Request processed in 10810us (11463us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788844494.654411:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788844494.654644:0:8088:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d7800 x1875739267849472/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788844510 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844494.654659:0:8088:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788844494.654676:0:8088:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91eefb6d7800 x1875739267849472/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788844510 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844494.654699:0:8088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8088:1875739267849472:0@lo:5: 00000004:00080000:1.0:1788844494.654713:0:8088:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788844495.034150:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844495.097982:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267849600:0@lo:13: 00000100:00100000:2.0:1788844495.098088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844495.098318:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267849600 00000100:00100000:1.0:1788844495.098328:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267849600 00000100:00100000:1.0:1788844495.098389:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788844495.098399:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267849600:12345-0@lo:13: 00002000:00000024:1.0:1788844495.098434:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844495.098487:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267849600:12345-0@lo:13: Request processed in 89us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844495.098495:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788844495.098558:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d5c00 x1875739267849600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844495.098578:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267849600:0@lo:13: 00010000:00010000:1.0:1788844496.058631:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844497.083734:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788844498.017456:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788844498.111624:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844498.739805:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844498.739961:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244757120 00000100:00100000:1.0:1788844498.739981:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244757120 00000100:00100000:1.0:1788844498.740024:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 113 00000100:00100000:1.0:1788844498.740033:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1875739244757120:12345-192.168.204.43@tcp:250: 00010000:00080000:1.0:1788844498.740062:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8ca16c13-8379-4c1a-af6d-609863f2bd5f@192.168.204.43@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1788844498.740103:0:5834:0:(genops.c:1385:class_connect()) connect: client 8ca16c13-8379-4c1a-af6d-609863f2bd5f, cookie 0x7f1093851e2d921f 00000100:00080000:1.0:1788844498.740250:0:5834:0:(import.c:65:import_set_state_nolock()) ffff91eec5752800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788844498.740324:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+5:2353:x1875739244757120:12345-192.168.204.43@tcp:250: Request processed in 290us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844498.740334:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 113 00000100:00100000:2.0:1788844498.762293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844498.762647:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244757248 00000100:00100000:2.0:1788844498.762658:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244757248 00000100:00100000:2.0:1788844498.762718:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 114 00000100:00100000:2.0:1788844498.762728:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+5:5585:x1875739244757248:12345-192.168.204.43@tcp:101: 00010000:00010000:2.0:1788844498.762746:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844498.762765:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d9226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f7f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844498.762795:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d9226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f1 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844498.762806:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d9226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f1 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844498.762816:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0205c400, rc 0) 00000100:00100000:2.0:1788844498.762874:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+6:5585:x1875739244757248:12345-192.168.204.43@tcp:101: Request processed in 147us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844498.762881:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 114 00000100:00100000:2.0:1788844498.770903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844498.770983:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244757376 00000100:00100000:3.0:1788844498.770993:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244757376 00000100:00100000:3.0:1788844498.771050:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:3.0:1788844498.771060:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+6:5585:x1875739244757376:12345-192.168.204.43@tcp:501: 00000100:00100000:3.0:1788844498.774107:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+6:5585:x1875739244757376:12345-192.168.204.43@tcp:501: Request processed in 3026us (3190us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788844498.774122:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:2.0:1788844498.787880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844498.787996:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244757504 00000100:00100000:1.0:1788844498.788006:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244757504 00000100:00100000:1.0:1788844498.788062:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:1.0:1788844498.788072:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+6:5585:x1875739244757504:12345-192.168.204.43@tcp:101: 00010000:00010000:1.0:1788844498.788113:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844498.788131:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bac00/0x7f1093851e2d922d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f7f8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844498.788163:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bac00/0x7f1093851e2d922d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f8 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844498.788175:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bac00/0x7f1093851e2d922d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f8 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844498.788184:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bac00, rc 0) 00000100:00100000:1.0:1788844498.788427:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+7:5585:x1875739244757504:12345-192.168.204.43@tcp:101: Request processed in 355us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844498.788434:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:2.0:1788844498.797457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844498.801701:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244757632 00000100:00100000:1.0:1788844498.801717:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244757632 00000100:00100000:1.0:1788844498.801777:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:1.0:1788844498.801788:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+7:5585:x1875739244757632:12345-192.168.204.43@tcp:501: 00000100:00100000:1.0:1788844498.802117:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:5585:x1875739244757632:12345-192.168.204.43@tcp:501: Request processed in 330us (4680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844498.802126:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:3.0:1788844498.805378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844498.805679:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244757760 00000100:00100000:2.0:1788844498.805692:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244757760 00000100:00100000:2.0:1788844498.805750:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:2.0:1788844498.805761:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:5585:x1875739244757760:12345-192.168.204.43@tcp:503: 00000100:00100000:2.0:1788844498.806081:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:5585:x1875739244757760:12345-192.168.204.43@tcp:503: Request processed in 320us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844498.806100:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:2.0:1788844498.815087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844498.815135:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244757888 00000100:00100000:2.0:1788844498.815146:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244757888 00000100:00100000:2.0:1788844498.815195:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:2.0:1788844498.815204:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:5604:x1875739244757888:12345-192.168.204.43@tcp:502: 00000100:00100000:2.0:1788844498.815506:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:5604:x1875739244757888:12345-192.168.204.43@tcp:502: Request processed in 302us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844498.815515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:3.0:1788844498.872205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844498.872572:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244758016 00000100:00100000:0.0:1788844498.872583:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244758016 00000100:00100000:0.0:1788844498.872651:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:0.0:1788844498.872661:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:5604:x1875739244758016:12345-192.168.204.43@tcp:502: 00000100:00100000:0.0:1788844498.872961:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:5604:x1875739244758016:12345-192.168.204.43@tcp:502: Request processed in 300us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844498.872969:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:3.0:1788844498.893064:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844498.893110:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244758144 00000100:00100000:3.0:1788844498.893120:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244758144 00000100:00100000:3.0:1788844498.893172:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:3.0:1788844498.893181:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:5585:x1875739244758144:12345-192.168.204.43@tcp:101: 00010000:00010000:3.0:1788844498.893197:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844498.893226:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f822 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844498.893254:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f822 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844498.893280:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f822 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844498.893289:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024800, rc 0) 00000100:00100000:3.0:1788844498.893472:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5585:x1875739244758144:12345-192.168.204.43@tcp:101: Request processed in 291us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844498.893479:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:0.0:1788844498.901392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844498.901821:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244758272 00000100:00100000:2.0:1788844498.901833:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244758272 00000100:00100000:2.0:1788844498.901888:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 122 00000100:00100000:2.0:1788844498.901898:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5585:x1875739244758272:12345-192.168.204.43@tcp:256: 20000000:01000000:2.0:1788844498.901924:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788844498.901945:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788844498.901949:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788844498.901952:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788844498.901954:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788844498.911797:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5585:x1875739244758272:12345-192.168.204.43@tcp:256: Request processed in 9891us (10404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844498.911812:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 122 00000100:00100000:3.0:1788844498.915798:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844498.915837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244758400 00000100:00100000:3.0:1788844498.915847:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244758400 00000100:00100000:3.0:1788844498.915906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:3.0:1788844498.915915:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5585:x1875739244758400:12345-192.168.204.43@tcp:101: 00010000:00010000:3.0:1788844498.915933:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844498.915953:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0024200/0x7f1093851e2d923b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f829 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844498.915982:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024200/0x7f1093851e2d923b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f829 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844498.915994:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0024200/0x7f1093851e2d923b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f829 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844498.916004:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024200, rc 0) 00000100:00100000:3.0:1788844498.916055:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5585:x1875739244758400:12345-192.168.204.43@tcp:101: Request processed in 141us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844498.916074:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:3.0:1788844498.924113:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844498.924247:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244758528 00000100:00100000:1.0:1788844498.924258:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244758528 00000100:00100000:1.0:1788844498.924317:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 124 00000100:00100000:1.0:1788844498.924327:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5585:x1875739244758528:12345-192.168.204.43@tcp:501: 00000100:00100000:1.0:1788844498.924698:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5585:x1875739244758528:12345-192.168.204.43@tcp:501: Request processed in 371us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844498.924716:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 124 00000100:00100000:0.0:1788844498.930699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844498.934409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244758656 00000100:00100000:3.0:1788844498.934423:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244758656 00000100:00100000:3.0:1788844498.934482:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 125 00000100:00100000:3.0:1788844498.934493:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5585:x1875739244758656:12345-192.168.204.43@tcp:503: 00000100:00100000:3.0:1788844498.934878:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5585:x1875739244758656:12345-192.168.204.43@tcp:503: Request processed in 384us (4188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844498.934886:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 125 00000100:00100000:0.0:1788844498.941172:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844498.941659:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244758784 00000100:00100000:3.0:1788844498.941672:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244758784 00000100:00100000:3.0:1788844498.941722:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 126 00000100:00100000:3.0:1788844498.941732:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5608:x1875739244758784:12345-192.168.204.43@tcp:502: 00000100:00100000:3.0:1788844498.942023:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5608:x1875739244758784:12345-192.168.204.43@tcp:502: Request processed in 290us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844498.942032:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 126 00000100:00100000:0.0:1788844498.945784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844498.948504:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244758912 00000100:00100000:3.0:1788844498.948520:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244758912 00000100:00100000:3.0:1788844498.948622:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 127 00000100:00100000:3.0:1788844498.948633:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5608:x1875739244758912:12345-192.168.204.43@tcp:502: 00000100:00100000:3.0:1788844498.948903:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5608:x1875739244758912:12345-192.168.204.43@tcp:502: Request processed in 271us (3128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844498.948912:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 127 00000100:00100000:2.0:1788844499.005661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844499.005715:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244759040 00000100:00100000:2.0:1788844499.005725:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244759040 00000100:00100000:2.0:1788844499.005768:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:2.0:1788844499.005775:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1875739244759040:12345-192.168.204.43@tcp:38: 00010000:00080000:2.0:1788844499.005809:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1788844499.012643:0:5839:0:(genops.c:1385:class_connect()) connect: client 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1, cookie 0x7f1093851e2d9242 00000004:00100000:2.0:1788844499.012688:0:5839:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788844499.012696:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788844499.075827:0:5839:0:(import.c:65:import_set_state_nolock()) ffff91eefb382000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788844499.076757:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2353:x1875739244759040:12345-192.168.204.43@tcp:38: Request processed in 70975us (71102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844499.076770:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00010000:00010000:2.0:1788844499.133017:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844499.194465:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267849984:0@lo:400: 00000100:00100000:0.0:1788844499.194527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844499.194612:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788844499.194618:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267850112:0@lo:400: 00000100:00100000:0.0:1788844499.194663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844499.194699:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267850112 00000100:00100000:0.0:1788844499.194707:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267850112 00000100:00100000:0.0:1788844499.194759:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788844499.194768:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267850112:12345-0@lo:400: 00000100:00100000:0.0:1788844499.194818:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267850112:12345-0@lo:400: Request processed in 51us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844499.194825:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788844499.194844:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788844499.194869:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aef800 x1875739267850112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844499.194881:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267850112:0@lo:400: 00000100:00100000:1.0:1788844499.194946:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267849728:0@lo:400: 00000100:00100000:1.0:1788844499.195044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844499.195073:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267850240:0@lo:400: 00000100:00100000:1.0:1788844499.195167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844499.195189:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788844499.195195:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267849856:0@lo:400: 00000100:00100000:1.0:1788844499.195218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844499.195235:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267850368:0@lo:400: 00000100:00100000:1.0:1788844499.195333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844499.195366:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267849984 00000100:00100000:1.0:1788844499.195370:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267849984 00000100:00100000:1.0:1788844499.195399:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267850240 00000100:00100000:1.0:1788844499.195401:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267850240 00000100:00100000:1.0:1788844499.195412:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267849856 00000100:00100000:1.0:1788844499.195414:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267849856 00000100:00100000:1.0:1788844499.195427:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788844499.195433:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267849984:12345-0@lo:400: 00000100:00100000:1.0:1788844499.195470:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267849984:12345-0@lo:400: Request processed in 38us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844499.195477:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788844499.195492:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788844499.195498:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267850240:12345-0@lo:400: 00000100:00100000:1.0:1788844499.195526:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267850240:12345-0@lo:400: Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844499.195531:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788844499.195584:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788844499.195601:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267849856:12345-0@lo:400: 00000100:00100000:1.0:1788844499.195631:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267849856:12345-0@lo:400: Request processed in 41us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844499.195636:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788844499.195660:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267850368 00000100:00100000:1.0:1788844499.195663:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267850368 00000100:00100000:1.0:1788844499.195689:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788844499.195696:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267850368:12345-0@lo:400: 00000100:00100000:1.0:1788844499.195726:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267850368:12345-0@lo:400: Request processed in 31us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844499.195732:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788844499.195749:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788844499.195753:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788844499.195771:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aeea00 x1875739267849856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844499.195781:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267849856:0@lo:400: 00010000:00080000:1.0:1788844499.195792:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aece00 x1875739267850368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844499.195799:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788844499.195812:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267850368:0@lo:400: 00010000:00080000:1.0:1788844499.195823:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aeca80 x1875739267850240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844499.195831:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267850240:0@lo:400: 00010000:00080000:1.0:1788844499.195856:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aed880 x1875739267849984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844499.195870:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267849984:0@lo:400: 00000100:00100000:0.0:1788844499.195947:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267849728 00000100:00100000:0.0:1788844499.195950:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267849728 00000100:00100000:0.0:1788844499.197187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788844499.197200:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267849728:12345-0@lo:400: 00000100:00100000:0.0:1788844499.197570:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267849728:12345-0@lo:400: Request processed in 371us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844499.197578:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788844499.199184:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267849728:0@lo:400: 00000100:00100000:1.0:1788844499.706600:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267850496:0@lo:13: 00000100:00100000:1.0:1788844499.706703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844499.708901:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267850496 00000100:00100000:2.0:1788844499.708916:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267850496 00000100:00100000:2.0:1788844499.708999:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788844499.709010:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267850496:12345-0@lo:13: 00002000:00000024:2.0:1788844499.709051:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788844499.716060:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267850496:12345-0@lo:13: Request processed in 7038us (9342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844499.716575:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788844499.723604:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aef800 x1875739267850496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844499.723639:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267850496:0@lo:13: 00000100:00100000:0.0:1788844500.096464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844500.096510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844500.098212:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244759168 00000100:00100000:2.0:1788844500.098238:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244759168 00000100:00100000:2.0:1788844500.098385:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244759296 00000100:00100000:2.0:1788844500.098389:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244759296 00000100:00100000:2.0:1788844500.098410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:2.0:1788844500.098419:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:0:x1875739244759168:12345-192.168.204.43@tcp:41: 00000004:00000024:2.0:1788844500.098466:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788844500.098562:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:0:x1875739244759168:12345-192.168.204.43@tcp:41: Request processed in 143us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844500.098570:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:2.0:1788844500.098603:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:2.0:1788844500.098625:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:5585:x1875739244759296:12345-192.168.204.43@tcp:41: 00000004:00000024:2.0:1788844500.098639:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788844500.098660:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:5585:x1875739244759296:12345-192.168.204.43@tcp:41: Request processed in 36us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844500.098666:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00080000:0.0:1788844500.104647:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844500.111714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844500.111872:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244759424 00000100:00100000:2.0:1788844500.111883:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244759424 00000100:00100000:2.0:1788844500.111944:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:2.0:1788844500.111955:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:5585:x1875739244759424:12345-192.168.204.43@tcp:40: 00000100:00100000:2.0:1788844500.112056:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:5585:x1875739244759424:12345-192.168.204.43@tcp:40: Request processed in 102us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844500.112063:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:2.0:1788844500.122612:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844500.122656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844500.122697:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844500.122824:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244759808 00000100:00100000:3.0:1788844500.122836:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244759808 00000100:00100000:3.0:1788844500.122909:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1788844500.122919:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:5585:x1875739244759808:12345-192.168.204.43@tcp:33: 00000100:00100000:0.0:1788844500.126308:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244759552 00000100:00100000:0.0:1788844500.126324:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244759552 00000100:00100000:0.0:1788844500.126373:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244759680 00000100:00100000:0.0:1788844500.126377:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244759680 00000100:00100000:0.0:1788844500.126404:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1788844500.126425:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875739244759552:12345-192.168.204.43@tcp:8: 00010000:00080000:0.0:1788844500.126457:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:0.0:1788844500.126489:0:6686:0:(genops.c:1385:class_connect()) connect: client 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1, cookie 0x7f1093851e2d9249 00002000:00100000:0.0:1788844500.126502:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1/ffff91eec71b6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788844500.126529:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788844500.127043:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:1.0:1788844500.127050:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875739244759680:12345-192.168.204.43@tcp:8: 00010000:00080000:1.0:1788844500.127069:0:6688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1788844500.127096:0:6688:0:(genops.c:1385:class_connect()) connect: client 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1, cookie 0x7f1093851e2d9250 00002000:00100000:1.0:1788844500.127102:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1/ffff91eec5756800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788844500.127109:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788844500.127489:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788844500.127522:0:6686:0:(import.c:65:import_set_state_nolock()) ffff91eec71b7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844500.127629:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2353:x1875739244759552:12345-192.168.204.43@tcp:8: Request processed in 1202us (4971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844500.127637:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00002000:00080000:1.0:1788844500.128053:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788844500.128073:0:6688:0:(import.c:65:import_set_state_nolock()) ffff91eec5755800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788844500.128104:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2353:x1875739244759680:12345-192.168.204.43@tcp:8: Request processed in 1053us (5406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844500.128111:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:0.0:1788844500.134497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844500.135492:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244759936 00000100:00100000:3.0:1788844500.135505:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244759936 00000100:00100000:3.0:1788844500.135592:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 129 00000100:00100000:3.0:1788844500.135602:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244759936:12345-192.168.204.43@tcp:400: 00000100:00100000:3.0:1788844500.135676:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244759936:12345-192.168.204.43@tcp:400: Request processed in 75us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844500.135683:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 129 00010000:00010000:0.0:1788844500.158674:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788844500.159393:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36335us 00000004:00200000:0.0:1788844500.185790:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788844500.185915:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:5585:x1875739244759808:12345-192.168.204.43@tcp:33: Request processed in 62992us (63309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844500.185930:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:0.0:1788844500.217990:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788844500.218017:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267850624:0@lo:13: 00000100:00100000:0.0:1788844500.218099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844500.218292:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267850624 00000100:00100000:1.0:1788844500.218301:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267850624 00000100:00100000:1.0:1788844500.218350:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788844500.218360:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267850624:12345-0@lo:13: 00002000:00000024:1.0:1788844500.218384:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844500.218459:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267850624:12345-0@lo:13: Request processed in 100us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844500.218466:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788844500.218612:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d6a00 x1875739267850624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844500.218633:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267850624:0@lo:13: 00000100:00100000:0.0:1788844500.451699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844500.451808:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244760064 00000100:00100000:3.0:1788844500.451829:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244760064 00000100:00100000:3.0:1788844500.451927:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:3.0:1788844500.451951:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:5625:x1875739244760064:12345-192.168.204.43@tcp:101: 00010000:00010000:3.0:1788844500.451984:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844500.456361:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f853 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844500.456462:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d925e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844500.456478:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d925e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844500.456496:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d925e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844500.456551:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788844500.456582:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844500.456609:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d925e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844500.456645:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f853 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844500.456668:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d925e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f853 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844500.456677:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eed38cfe00) 00010000:00010000:3.0:1788844500.456679:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788844500.456683:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025e00, rc 0) 00000100:00100000:3.0:1788844500.456761:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:5625:x1875739244760064:12345-192.168.204.43@tcp:101: Request processed in 4813us (5071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844500.456770:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00010000:00010000:2.0:1788844501.178255:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844502.202192:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788844502.825971:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000100:00100000:2.0:1788844503.218837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844503.218940:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244760192 00000100:00100000:1.0:1788844503.218951:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244760192 00000100:00100000:1.0:1788844503.219041:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:1.0:1788844503.219052:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:5677:x1875739244760192:12345-192.168.204.43@tcp:41: 00000004:00000024:1.0:1788844503.219110:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788844503.219198:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:5677:x1875739244760192:12345-192.168.204.43@tcp:41: Request processed in 148us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844503.219205:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00080000:0.0:1788844503.221791:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844503.226646:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844503.226814:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244760320 00000100:00100000:1.0:1788844503.226825:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244760320 00000100:00100000:1.0:1788844503.226895:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:1.0:1788844503.226905:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:5677:x1875739244760320:12345-192.168.204.43@tcp:13: 00002000:00000024:1.0:1788844503.226947:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844503.227018:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:5677:x1875739244760320:12345-192.168.204.43@tcp:13: Request processed in 114us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844503.227025:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00080000:0.0:1788844503.227604:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788844503.228365:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844503.232992:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844503.234777:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244760448 00000100:00100000:1.0:1788844503.234794:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244760448 00000100:00100000:1.0:1788844503.234888:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:1.0:1788844503.234898:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:5677:x1875739244760448:12345-192.168.204.43@tcp:13: 00002000:00000024:1.0:1788844503.234938:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788844503.235023:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:5677:x1875739244760448:12345-192.168.204.43@tcp:13: Request processed in 126us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844503.235047:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00080000:0.0:1788844503.235255:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788844504.253635:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844504.315002:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267850752:0@lo:400: 00000100:00100000:2.0:1788844504.315110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844504.315188:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267851264:0@lo:400: 00000100:00100000:2.0:1788844504.315221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844504.315265:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788844504.315271:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267850880:0@lo:400: 00000100:00100000:2.0:1788844504.315296:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844504.315314:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267851392:0@lo:400: 00000100:00100000:2.0:1788844504.315357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844504.315396:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267851136:0@lo:400: 00000100:00100000:2.0:1788844504.315420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844504.315439:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788844504.315444:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267851008:0@lo:400: 00000100:00100000:2.0:1788844504.315489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844504.315562:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267851264 00000100:00100000:2.0:1788844504.315572:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267851264 00000100:00100000:2.0:1788844504.315646:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267850880 00000100:00100000:2.0:1788844504.315650:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267850880 00000100:00100000:2.0:1788844504.315663:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267851008 00000100:00100000:2.0:1788844504.315665:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267851008 00000100:00100000:2.0:1788844504.315682:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788844504.315693:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267851264:12345-0@lo:400: 00000100:00100000:3.0:1788844504.315873:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788844504.315886:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788844504.316111:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267851264:12345-0@lo:400: Request processed in 418us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844504.316121:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788844504.316159:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788844504.316167:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267850880:12345-0@lo:400: 00000100:00100000:2.0:1788844504.316199:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267850880:12345-0@lo:400: Request processed in 34us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844504.316205:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788844504.316217:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788844504.316380:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267851008:12345-0@lo:400: 00000100:00100000:2.0:1788844504.316423:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267851008:12345-0@lo:400: Request processed in 200us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844504.316429:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788844504.316507:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267851008:0@lo:400: 00000100:00100000:2.0:1788844504.316633:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267851392 00000100:00100000:2.0:1788844504.316638:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267851392 00000100:00100000:2.0:1788844504.316673:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267851136 00000100:00100000:2.0:1788844504.316675:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267851136 00000100:00100000:2.0:1788844504.316694:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788844504.316701:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267851392:12345-0@lo:400: 00000100:00080000:0.0:1788844504.317710:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844504.319400:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267851392:12345-0@lo:400: Request processed in 2686us (4029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844504.319419:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788844504.319473:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788844504.319489:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267851136:12345-0@lo:400: 00000100:00100000:2.0:1788844504.319588:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267851136:12345-0@lo:400: Request processed in 108us (4166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844504.319595:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788844504.319633:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267850752 00000100:00100000:2.0:1788844504.319643:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267850752 00000100:00100000:2.0:1788844504.319689:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788844504.319696:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267850752:12345-0@lo:400: 00000100:00100000:2.0:1788844504.319731:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267850752:12345-0@lo:400: Request processed in 35us (4623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844504.319738:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:2.0:1788844504.319836:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eef3171180 x1875739267851136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844504.319855:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267851136:0@lo:400: 00000100:00100000:3.0:1788844504.319931:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267850880:0@lo:400: 00010000:00080000:3.0:1788844504.319951:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eef3172a00 x1875739267851392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844504.319962:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267851392:0@lo:400: 00000100:00100000:3.0:1788844504.319990:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267850752:0@lo:400: 00000100:00100000:3.0:1788844504.320005:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267851264:0@lo:400: 00000100:00080000:0.0:1788844504.320136:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844504.320140:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1788844504.407240:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000100:00100000:3.0:1788844504.825852:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788844504.825881:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267851520:0@lo:13: 00000100:00100000:3.0:1788844504.825978:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844504.827311:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267851520 00000100:00100000:0.0:1788844504.827385:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267851520 00000100:00100000:0.0:1788844504.827461:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788844504.827472:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267851520:12345-0@lo:13: 00002000:00000024:0.0:1788844504.827528:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788844504.827789:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267851520:12345-0@lo:13: Request processed in 318us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844504.827798:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788844504.833147:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aef800 x1875739267851520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844504.833179:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267851520:0@lo:13: 00000001:00100000:1.0:1788844504.939114:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00010000:00010000:1.0:1788844505.276089:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844505.338772:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267851648:0@lo:13: 00000100:00100000:3.0:1788844505.338845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844505.339381:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267851648 00000100:00100000:2.0:1788844505.339390:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267851648 00000100:00100000:2.0:1788844505.339450:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788844505.339459:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267851648:12345-0@lo:13: 00002000:00000024:2.0:1788844505.339507:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844505.359804:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267851648:12345-0@lo:13: Request processed in 20335us (20947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844505.359819:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788844505.360145:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d6680 x1875739267851648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844505.360172:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267851648:0@lo:13: 00000100:00100000:3.0:1788844505.552280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844505.552458:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244760576 00000100:00100000:2.0:1788844505.552481:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244760576 00000100:00100000:2.0:1788844505.552621:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 131 00000100:00100000:2.0:1788844505.552634:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2357:x1875739244760576:12345-192.168.204.43@tcp:400: 00000100:00100000:2.0:1788844505.552744:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2357:x1875739244760576:12345-192.168.204.43@tcp:400: Request processed in 113us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844505.552753:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 131 00000100:00100000:3.0:1788844505.552776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844505.552803:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244760832 00000100:00100000:2.0:1788844505.552807:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244760832 00000100:00100000:1.0:1788844505.553062:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844505.553102:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244760704 00000100:00100000:1.0:1788844505.553106:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244760704 00000100:00100000:1.0:1788844505.553145:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:1.0:1788844505.553153:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244760704:12345-192.168.204.43@tcp:400: 00000100:00100000:1.0:1788844505.553190:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244760704:12345-192.168.204.43@tcp:400: Request processed in 38us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844505.553196:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00080000:0.0:1788844505.553367:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788844505.553373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844505.553514:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:2.0:1788844505.553526:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244760832:12345-192.168.204.43@tcp:400: 00000100:00100000:2.0:1788844505.553581:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244760832:12345-192.168.204.43@tcp:400: Request processed in 59us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844505.560145:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844505.561745:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244760960 00000100:00100000:3.0:1788844505.561767:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244760960 00000100:00080000:0.0:1788844505.561884:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788844505.564580:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:3.0:1788844505.567158:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:3.0:1788844505.567194:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244760960:12345-192.168.204.43@tcp:400: 00000100:00100000:3.0:1788844505.567319:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244760960:12345-192.168.204.43@tcp:400: Request processed in 145us (7190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844505.568249:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00010000:00010000:0.0:1788844506.297694:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788844506.620659:0:8291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788844507.322471:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844508.345919:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844509.373879:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844509.434995:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267851776:0@lo:400: 00000100:00100000:1.0:1788844509.435071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844509.435120:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267852288:0@lo:400: 00000100:00100000:1.0:1788844509.435148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844509.435174:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788844509.435179:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267851904:0@lo:400: 00000100:00100000:1.0:1788844509.435200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844509.435219:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267852416:0@lo:400: 00000100:00100000:1.0:1788844509.435241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844509.435269:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267852032:0@lo:400: 00000100:00100000:1.0:1788844509.435288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844509.435302:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844509.435314:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267852160:0@lo:400: 00000100:00100000:1.0:1788844509.435364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844509.435407:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267851776 00000100:00100000:1.0:1788844509.435414:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267851776 00000100:00100000:1.0:1788844509.435458:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788844509.435467:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267851776:12345-0@lo:400: 00000100:00100000:1.0:1788844509.435514:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267851776:12345-0@lo:400: Request processed in 48us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844509.435521:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788844509.435564:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267852288 00000100:00100000:1.0:1788844509.435568:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267852288 00000100:00100000:1.0:1788844509.435597:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267851904 00000100:00100000:1.0:1788844509.435600:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267851904 00000100:00100000:1.0:1788844509.435610:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267852032 00000100:00100000:1.0:1788844509.435611:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267852032 00000100:00100000:1.0:1788844509.435624:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788844509.435629:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267852288:12345-0@lo:400: 00000100:00100000:1.0:1788844509.435659:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267852288:12345-0@lo:400: Request processed in 30us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844509.435664:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788844509.435675:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788844509.435680:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267851904:12345-0@lo:400: 00000100:00100000:1.0:1788844509.435702:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267851904:12345-0@lo:400: Request processed in 22us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844509.435707:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788844509.435717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788844509.435722:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267852032:12345-0@lo:400: 00000100:00100000:1.0:1788844509.435750:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267852032:12345-0@lo:400: Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844509.435762:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788844509.435791:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267852416 00000100:00100000:1.0:1788844509.435795:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267852416 00000100:00100000:1.0:1788844509.435819:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267852160 00000100:00100000:1.0:1788844509.435822:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267852160 00000100:00100000:1.0:1788844509.435841:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788844509.435846:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267852416:12345-0@lo:400: 00000100:00100000:1.0:1788844509.435876:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267852416:12345-0@lo:400: Request processed in 30us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844509.435882:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788844509.435893:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788844509.435899:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267852160:12345-0@lo:400: 00000100:00100000:1.0:1788844509.435925:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267852160:12345-0@lo:400: Request processed in 26us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844509.435930:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788844509.435956:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788844509.435960:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788844509.435962:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788844509.435993:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb395500 x1875739267852160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844509.436005:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267852160:0@lo:400: 00000100:00100000:1.0:1788844509.436018:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267852032:0@lo:400: 00000100:00100000:1.0:1788844509.436049:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267851904:0@lo:400: 00010000:00080000:1.0:1788844509.436058:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb397b80 x1875739267852416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844509.436067:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267852416:0@lo:400: 00000100:00100000:1.0:1788844509.436084:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267851776:0@lo:400: 00000100:00100000:1.0:1788844509.436093:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267852288:0@lo:400: 00000100:00100000:1.0:1788844509.948665:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267852544:0@lo:13: 00000100:00100000:1.0:1788844509.948743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844509.949016:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267852544 00000100:00100000:0.0:1788844509.949027:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267852544 00000100:00100000:0.0:1788844509.949108:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788844509.949119:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267852544:12345-0@lo:13: 00002000:00000024:0.0:1788844509.949666:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844509.949736:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267852544:12345-0@lo:13: Request processed in 618us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844509.949744:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788844509.950826:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aed880 x1875739267852544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844509.950852:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267852544:0@lo:13: 00010000:00010000:0.0:1788844510.394774:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844510.458108:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844510.458340:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267852672:0@lo:13: 00000100:00100000:1.0:1788844510.458411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844510.464003:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267852672 00000100:00100000:2.0:1788844510.464024:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267852672 00000100:00100000:2.0:1788844510.464105:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788844510.464382:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267852672:12345-0@lo:13: 00002000:00000024:2.0:1788844510.464437:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844510.464558:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267852672:12345-0@lo:13: Request processed in 420us (6123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844510.464566:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788844510.464710:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb397b80 x1875739267852672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844510.464731:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267852672:0@lo:13: 00000100:00100000:0.0:1788844510.657248:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844510.657296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844510.657329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844510.657357:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844510.657397:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244761088 00000100:00100000:0.0:1788844510.657408:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244761088 00000100:00100000:2.0:1788844510.657436:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244761472 00000100:00100000:2.0:1788844510.657443:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244761472 00000100:00100000:0.0:1788844510.657469:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 133 00000100:00100000:0.0:1788844510.657483:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244761088:12345-192.168.204.43@tcp:400: 00000100:00100000:2.0:1788844510.657497:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244761344 00000100:00100000:2.0:1788844510.657502:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244761344 00000100:00100000:2.0:1788844510.657569:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:0.0:1788844510.657583:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244761088:12345-192.168.204.43@tcp:400: Request processed in 102us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844510.657587:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244761472:12345-192.168.204.43@tcp:400: 00000100:00100000:0.0:1788844510.657598:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 133 00000100:00100000:2.0:1788844510.657633:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244761472:12345-192.168.204.43@tcp:400: Request processed in 54us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844510.657692:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244761216 00000100:00100000:3.0:1788844510.657698:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244761216 00000100:00100000:3.0:1788844510.657733:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:3.0:1788844510.657740:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244761216:12345-192.168.204.43@tcp:400: 00000100:00100000:3.0:1788844510.657772:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244761216:12345-192.168.204.43@tcp:400: Request processed in 33us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844510.657779:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:0.0:1788844510.657915:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:0.0:1788844510.657927:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244761344:12345-192.168.204.43@tcp:400: 00000100:00100000:0.0:1788844510.657959:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244761344:12345-192.168.204.43@tcp:400: Request processed in 35us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844510.660130:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00080000:2.0:1788844510.660177:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788844510.660182:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788844510.660184:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788844510.661172:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000020:00000080:2.0:1788844511.168496:0:8439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4c580c80 20000000:00000080:2.0:1788844511.168515:0:8439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eefb4fec00 uarg=0000000000000000 20000000:01000000:2.0:1788844511.168665:0:8439:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788844511.168667:0:8439:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788844511.168672:0:8439:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788844511.168677:0:8439:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788844511.168681:0:8439:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788844511.168696:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788844511.168699:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788844511.168902:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788844511.168904:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788844511.170292:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788844511.171200:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788844511.171371:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788844511.171427:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788844511.171439:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788844511.171441:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788844511.178079:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788844511.182076:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788844511.182450:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788844511.182528:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788844511.182577:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788844511.182580:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788844511.183459:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788844511.184082:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788844511.184145:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788844511.184191:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788844511.184203:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788844511.184206:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788844511.185913:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788844511.186709:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788844511.186780:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788844511.186820:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1788844511.186836:0:8439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788844511.186857:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186875:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d915b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186883:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0025200/0x7f1093851e2d918c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9185 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186889:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d91af expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186896:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0024000/0x7f1093851e2d91c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d91bd expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186902:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5527c00/0x7f1093851e2d91d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d91cb expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186918:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0025800/0x7f1093851e2d91ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d91e7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186926:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5526800/0x7f1093851e2d9211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d920a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186935:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d9226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f1 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186942:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed99bac00/0x7f1093851e2d922d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f8 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186950:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.186993:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed99bac00/0x7f1093851e2d922d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f8 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.187011:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eed99bac00/0x7f1093851e2d922d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f8 expref: 9 pid: 5834 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.187028:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267852800:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844511.187182:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d9226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f1 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.187191:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d9226 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f1 expref: 9 pid: 5831 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.187199:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267852928:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844511.187317:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5526800/0x7f1093851e2d9211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d920a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.187326:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5526800/0x7f1093851e2d9211 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d920a expref: 18 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.187335:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb392a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853056:0@lo:104: 00000100:00100000:2.0:1788844511.187388:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788844511.187437:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0025800/0x7f1093851e2d91ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d91e7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.187445:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec0025800/0x7f1093851e2d91ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d91e7 expref: 18 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.187453:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853184:0@lo:104: 00000100:00100000:2.0:1788844511.187475:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788844511.187515:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5527c00/0x7f1093851e2d91d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d91cb expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.187524:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5527c00/0x7f1093851e2d91d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d91cb expref: 18 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.187532:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb392300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853312:0@lo:104: 00010000:00010000:2.0:1788844511.187591:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0024000/0x7f1093851e2d91c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d91bd expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.187599:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec0024000/0x7f1093851e2d91c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d91bd expref: 18 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.187607:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853440:0@lo:104: 00010000:00010000:2.0:1788844511.187640:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d91af expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.187647:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d91af expref: 18 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.187655:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853568:0@lo:104: 00010000:00010000:2.0:1788844511.187675:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0025200/0x7f1093851e2d918c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d9185 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.187682:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec0025200/0x7f1093851e2d918c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d9185 expref: 18 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.187689:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853696:0@lo:104: 00010000:00010000:2.0:1788844511.187710:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d915b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.187717:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9162 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d915b expref: 18 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.187725:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853824:0@lo:104: 00000100:00100000:2.0:1788844511.187742:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed0389240 going to sleep for 11 seconds 00000100:00100000:3.0:1788844511.187906:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788844511.187927:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844511.187940:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844511.187948:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844511.187955:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844511.187963:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844511.187972:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267853056 00000100:00100000:3.0:1788844511.187978:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267853056 00000100:00100000:3.0:1788844511.188013:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267853184 00000100:00100000:3.0:1788844511.188016:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267853184 00000100:00100000:3.0:1788844511.188024:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267853312 00000100:00100000:3.0:1788844511.188026:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267853312 00000100:00100000:3.0:1788844511.188034:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267853440 00000100:00100000:3.0:1788844511.188036:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267853440 00000100:00100000:3.0:1788844511.188043:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267853568 00000100:00100000:3.0:1788844511.188045:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267853568 00000100:00100000:3.0:1788844511.188053:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267853696 00000100:00100000:3.0:1788844511.188054:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267853696 00000100:00100000:3.0:1788844511.188062:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267853824 00000100:00100000:3.0:1788844511.188064:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267853824 00000100:00100000:3.0:1788844511.188076:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788844511.188083:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb392680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:8439:x1875739267853056:12345-0@lo:104: 00010000:00010000:3.0:1788844511.188094:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188161:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788844511.188167:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb392680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+9:8439:x1875739267853056:12345-0@lo:104: Request processed in 85us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.188175:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788844511.188192:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788844511.188198:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef0165cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+8:8439:x1875739267853184:12345-0@lo:104: 00010000:00010000:3.0:1788844511.188213:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188259:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788844511.188264:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef0165cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+8:8439:x1875739267853184:12345-0@lo:104: Request processed in 67us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.188270:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788844511.188314:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788844511.188320:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+7:8439:x1875739267853312:12345-0@lo:104: 00010000:00010000:3.0:1788844511.188327:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188351:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788844511.188356:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+7:8439:x1875739267853312:12345-0@lo:104: Request processed in 37us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.188373:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788844511.188384:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788844511.188389:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+6:8439:x1875739267853440:12345-0@lo:104: 00010000:00010000:3.0:1788844511.188396:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188419:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788844511.188423:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+6:8439:x1875739267853440:12345-0@lo:104: Request processed in 35us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.188429:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788844511.188439:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788844511.188444:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:8439:x1875739267853568:12345-0@lo:104: 00010000:00010000:3.0:1788844511.188457:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188487:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788844511.188492:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:8439:x1875739267853568:12345-0@lo:104: Request processed in 48us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.188499:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788844511.188511:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788844511.188517:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:8439:x1875739267853696:12345-0@lo:104: 00010000:00010000:3.0:1788844511.188524:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188594:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788844511.188599:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:8439:x1875739267853696:12345-0@lo:104: Request processed in 83us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.188605:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788844511.188616:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788844511.188622:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:8439:x1875739267853824:12345-0@lo:104: 00010000:00010000:3.0:1788844511.188629:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188651:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788844511.188656:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:8439:x1875739267853824:12345-0@lo:104: Request processed in 34us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.188661:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788844511.188676:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788844511.188683:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188696:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205c200 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844511.188701:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188711:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844511.188718:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844511.188724:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788844511.188761:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188768:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844511.188788:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188795:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205c200/0x7f1093851e2d920a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9211 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188807:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788844511.188811:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188816:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205da00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844511.188819:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188837:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844511.188843:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844511.188848:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788844511.188861:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188867:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844511.188873:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188879:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d91e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188890:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788844511.188893:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188898:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024600 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844511.188901:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188907:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844511.188913:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844511.188925:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788844511.188939:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188945:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844511.188958:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188965:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0024600/0x7f1093851e2d91cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188973:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788844511.188976:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188981:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205ce00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844511.188983:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.188990:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844511.188997:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844511.189002:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788844511.189013:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189019:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844511.189031:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189037:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205ce00/0x7f1093851e2d91bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189046:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788844511.189049:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189054:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205dc00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844511.189057:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189063:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844511.189069:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844511.189074:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788844511.189086:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189091:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844511.189095:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189100:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205dc00/0x7f1093851e2d91af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d91b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189109:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788844511.189118:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189124:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527000 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844511.189126:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189132:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844511.189139:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844511.189144:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788844511.189157:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189163:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844511.189166:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189172:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d9185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d918c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189181:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844511.189184:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189190:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844511.189193:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189210:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844511.189216:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844511.189222:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788844511.189236:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189242:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844511.189246:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189252:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2d915b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9162 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189266:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844511.189268:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844511.189270:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844511.189286:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267854336:0@lo:103: 00000100:00100000:3.0:1788844511.189325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844511.189354:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788844511.189378:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267854208:0@lo:103: 00000100:00100000:3.0:1788844511.189399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844511.189417:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267854720:0@lo:103: 00000100:00100000:3.0:1788844511.189435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844511.189468:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267854336 00000100:00100000:3.0:1788844511.189481:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267854336 00010000:00010000:3.0:1788844511.189509:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0024000/0x7f1093851e2d91c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d91bd expref: 19 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844511.189528:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267854208 00000100:00100000:3.0:1788844511.189531:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267854208 00010000:00010000:3.0:1788844511.189568:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5527c00/0x7f1093851e2d91d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d91cb expref: 20 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844511.189578:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267854720 00000100:00100000:3.0:1788844511.189580:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267854720 00010000:00010000:3.0:1788844511.189590:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9162 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d915b expref: 21 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844511.189603:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788844511.189609:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+21:3306:x1875739267854336:12345-0@lo:103: 00010000:00010000:3.0:1788844511.189621:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844511.189626:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0024000/0x7f1093851e2d91c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d91bd expref: 21 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189635:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0024000/0x7f1093851e2d91c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d91bd expref: 21 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189655:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844511.189687:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+21:3306:x1875739267854336:12345-0@lo:103: Request processed in 78us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.189694:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788844511.189709:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788844511.189715:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01670700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+20:3306:x1875739267854208:12345-0@lo:103: 00010000:00010000:3.0:1788844511.189723:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844511.189732:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5527c00/0x7f1093851e2d91d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d91cb expref: 20 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189741:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5527c00/0x7f1093851e2d91d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d91cb expref: 20 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189751:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844511.189774:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01670700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+20:3306:x1875739267854208:12345-0@lo:103: Request processed in 59us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.189780:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788844511.189793:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788844511.189799:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267854720:12345-0@lo:103: 00010000:00010000:3.0:1788844511.189807:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844511.189811:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9162 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d915b expref: 19 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189819:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9162 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d915b expref: 19 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.189829:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844511.189849:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267854720:12345-0@lo:103: Request processed in 51us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.189855:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788844511.189896:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267854208:0@lo:103: 00000100:00100000:3.0:1788844511.189905:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267854720:0@lo:103: 00000100:00100000:3.0:1788844511.189911:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267854336:0@lo:103: 00000100:00100000:2.0:1788844511.190486:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb392a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853056:0@lo:104: 00000100:00100000:2.0:1788844511.190498:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853184:0@lo:104: 00010000:00010000:2.0:1788844511.190507:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5527c00/0x7f1093851e2d91d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d91cb expref: 18 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.190518:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb392300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853312:0@lo:104: 00010000:00010000:2.0:1788844511.190527:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0024000/0x7f1093851e2d91c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d91bd expref: 17 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.190572:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853440:0@lo:104: 00000100:00100000:2.0:1788844511.190585:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853568:0@lo:104: 00000100:00100000:2.0:1788844511.190593:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853696:0@lo:104: 00010000:00010000:2.0:1788844511.190601:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5527400/0x7f1093851e2d9162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d915b expref: 16 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844511.190608:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267853824:0@lo:104: 00010000:00010000:0.0:1788844511.190851:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844511.191659:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267853952:0@lo:103: 00000100:00100000:0.0:1788844511.191714:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844511.191760:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267854464:0@lo:103: 00000100:00100000:0.0:1788844511.191781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844511.191807:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788844511.191813:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267854080:0@lo:103: 00000100:00100000:0.0:1788844511.191870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844511.191894:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267854592:0@lo:103: 00000100:00100000:0.0:1788844511.191918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844511.191952:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267853952 00000100:00100000:0.0:1788844511.191959:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267853952 00010000:00010000:0.0:1788844511.191990:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5526800/0x7f1093851e2d9211 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d920a expref: 16 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844511.192008:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267854464 00000100:00100000:0.0:1788844511.192011:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267854464 00010000:00010000:0.0:1788844511.192021:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d91af expref: 17 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844511.192030:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267854080 00000100:00100000:0.0:1788844511.192033:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267854080 00010000:00010000:0.0:1788844511.192041:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0025800/0x7f1093851e2d91ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d91e7 expref: 18 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844511.192050:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267854592 00000100:00100000:0.0:1788844511.192053:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267854592 00010000:00010000:0.0:1788844511.192061:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0025200/0x7f1093851e2d918c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9185 expref: 19 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844511.192072:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788844511.192079:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267853952:12345-0@lo:103: 00010000:00010000:0.0:1788844511.192092:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844511.192097:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5526800/0x7f1093851e2d9211 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d920a expref: 19 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192106:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5526800/0x7f1093851e2d9211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d920a expref: 19 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192144:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526800/0x7f1093851e2d9211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d920a expref: 19 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192156:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844511.192191:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:3307:x1875739267853952:12345-0@lo:103: Request processed in 112us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844511.192198:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788844511.192215:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788844511.192234:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:3307:x1875739267854464:12345-0@lo:103: 00010000:00010000:0.0:1788844511.192243:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844511.192247:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d91af expref: 17 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192255:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d91af expref: 17 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192265:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0025600/0x7f1093851e2d91b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d91af expref: 17 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192274:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844511.192295:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3307:x1875739267854464:12345-0@lo:103: Request processed in 63us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844511.192301:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788844511.192313:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788844511.192318:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5992d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:3307:x1875739267854080:12345-0@lo:103: 00010000:00010000:0.0:1788844511.192325:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844511.192329:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0025800/0x7f1093851e2d91ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d91e7 expref: 15 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192342:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0025800/0x7f1093851e2d91ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d91e7 expref: 15 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192351:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0025800/0x7f1093851e2d91ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d91e7 expref: 15 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192371:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844511.192396:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5992d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:3307:x1875739267854080:12345-0@lo:103: Request processed in 77us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844511.192402:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788844511.192415:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788844511.192421:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:3307:x1875739267854592:12345-0@lo:103: 00010000:00010000:0.0:1788844511.192429:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844511.192433:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0025200/0x7f1093851e2d918c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9185 expref: 13 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192442:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0025200/0x7f1093851e2d918c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d9185 expref: 13 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192452:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0025200/0x7f1093851e2d918c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d9185 expref: 13 pid: 5834 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844511.192459:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844511.192478:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:3307:x1875739267854592:12345-0@lo:103: Request processed in 58us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844511.192483:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788844511.192553:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267854080:0@lo:103: 00000100:00100000:0.0:1788844511.192563:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267854592:0@lo:103: 00000100:00100000:0.0:1788844511.192579:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267853952:0@lo:103: 00000100:00100000:0.0:1788844511.192586:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267854464:0@lo:103: 00000100:00100000:0.0:1788844511.197741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844511.197788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844511.197926:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267852800:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844511.197939:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875739267852928:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844511.197987:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844511.198231:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244761728 00000100:00100000:3.0:1788844511.198239:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244761728 00010000:00010000:3.0:1788844511.198290:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d9226 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f1 expref: 10 pid: 5831 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844511.198324:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244761600 00000100:00100000:3.0:1788844511.198328:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244761600 00010000:00010000:3.0:1788844511.198338:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed99bac00/0x7f1093851e2d922d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f8 expref: 11 pid: 5834 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844511.198353:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:3.0:1788844511.198372:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5992d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:2354:x1875739244761728:12345-192.168.204.43@tcp:103: 00010000:00010000:3.0:1788844511.198387:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844511.198393:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d9226 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f1 expref: 11 pid: 5831 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198402:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d9226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f1 expref: 11 pid: 5831 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198423:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d9226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f1 expref: 11 pid: 5831 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198438:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844511.198509:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5992d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244761728:12345-192.168.204.43@tcp:103: Request processed in 147us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.198518:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:3.0:1788844511.198557:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:3.0:1788844511.198563:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5991180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:2354:x1875739244761600:12345-192.168.204.43@tcp:103: 00010000:00010000:3.0:1788844511.198572:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844511.198577:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed99bac00/0x7f1093851e2d922d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f8 expref: 9 pid: 5834 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198599:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed99bac00/0x7f1093851e2d922d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f8 expref: 9 pid: 5834 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198611:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bac00/0x7f1093851e2d922d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f7f8 expref: 9 pid: 5834 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198622:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198631:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198645:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198651:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198657:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198664:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198671:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205c000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844511.198676:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198684:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198704:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.198714:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844511.198735:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5991180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:2354:x1875739244761600:12345-192.168.204.43@tcp:103: Request processed in 172us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844511.198741:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00010000:00010000:2.0:1788844511.199444:0:8439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.199455:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844511.199462:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9265 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844511.420476:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788844512.314865:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788844512.314876:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eefacdc000 from 39 10000000:01000000:0.0:1788844512.314882:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788844512.314947:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.314960:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.314976:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844512.315005:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5990e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267854848:0@lo:101: 00000100:00100000:0.0:1788844512.315094:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844512.316378:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec3366e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788844512.330100:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267854848 00000100:00100000:1.0:1788844512.330116:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267854848 00000100:00100000:1.0:1788844512.330208:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788844512.330219:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+12:5836:x1875739267854848:12345-0@lo:101: 00010000:00010000:1.0:1788844512.330233:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844512.330252:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d9273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d926c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.330280:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d9273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d926c expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.330291:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d9273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d926c expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.330317:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bb000, rc 0) 00000100:00100000:1.0:1788844512.330418:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267854848:12345-0@lo:101: Request processed in 200us (15322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844512.330425:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788844512.330503:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5990e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267854848:0@lo:101: 00010000:00010000:2.0:1788844512.330523:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.330552:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844512.330632:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267854976:0@lo:501: 00000100:00100000:2.0:1788844512.330665:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844512.330703:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed0389240 going to sleep for 11 seconds 00000100:00100000:1.0:1788844512.330816:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267854976 00000100:00100000:1.0:1788844512.330821:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267854976 00000100:00100000:1.0:1788844512.330851:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788844512.330858:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267854976:12345-0@lo:501: 00000100:00100000:1.0:1788844512.331112:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267854976:12345-0@lo:501: Request processed in 253us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844512.331119:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788844512.331211:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267854976:0@lo:501: 00000100:00100000:3.0:1788844512.331258:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267855104:0@lo:503: 00000100:00100000:3.0:1788844512.331296:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844512.331316:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1600 going to sleep for 11 seconds 00000100:00100000:1.0:1788844512.331618:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267855104 00000100:00100000:1.0:1788844512.331622:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267855104 00000100:00100000:1.0:1788844512.331644:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788844512.331650:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267855104:12345-0@lo:503: 00000100:00100000:1.0:1788844512.331803:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267855104:12345-0@lo:503: Request processed in 152us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844512.331809:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788844512.331890:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267855104:0@lo:503: 00000100:00100000:0.0:1788844512.338948:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5992a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8455:1875739267855232:0@lo:502: 00000100:00100000:0.0:1788844512.339043:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844512.339103:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec3366d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788844512.339258:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267855232 00000100:00100000:1.0:1788844512.339267:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267855232 00000100:00100000:1.0:1788844512.339319:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788844512.339329:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:8455:x1875739267855232:12345-0@lo:502: 00000100:00100000:1.0:1788844512.339651:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:8455:x1875739267855232:12345-0@lo:502: Request processed in 323us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844512.339658:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788844512.339843:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5992a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8455:1875739267855232:0@lo:502: 00000100:00100000:2.0:1788844512.339899:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8455:1875739267855360:0@lo:502: 00000100:00100000:2.0:1788844512.339946:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844512.339973:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed03899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844512.340670:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267855360 00000100:00100000:1.0:1788844512.340677:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267855360 00000100:00100000:1.0:1788844512.340798:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788844512.340807:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:8455:x1875739267855360:12345-0@lo:502: 00000100:00100000:1.0:1788844512.341041:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:8455:x1875739267855360:12345-0@lo:502: Request processed in 234us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844512.341049:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788844512.341369:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8455:1875739267855360:0@lo:502: 00000040:00080000:3.0:1788844512.341402:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788844512.341480:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788844512.341501:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788844512.341513:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844512.341525:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844512.341563:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788844512.341566:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788844512.341569:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788844512.341608:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844512.341616:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844512.341624:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844512.341641:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267855488:0@lo:101: 00000100:00100000:3.0:1788844512.341677:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844512.352103:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788844512.360279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267855488 00000100:00100000:2.0:1788844512.360298:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267855488 00000100:00100000:2.0:1788844512.360377:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788844512.360387:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+13:5836:x1875739267855488:12345-0@lo:101: 00010000:00010000:2.0:1788844512.360404:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844512.360423:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d927a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.360454:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d927a expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.360475:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d927a expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.360485:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0205c000, rc 0) 00000100:00100000:2.0:1788844512.360585:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267855488:12345-0@lo:101: Request processed in 200us (18907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844512.360592:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788844512.360843:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267855488:0@lo:101: 00010000:00010000:3.0:1788844512.360863:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844512.360872:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844512.360941:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267855616:0@lo:501: 00000100:00100000:3.0:1788844512.360975:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844512.361001:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788844512.362734:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267855616 00000100:00100000:0.0:1788844512.362751:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267855616 00000100:00100000:0.0:1788844512.362808:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788844512.362819:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267855616:12345-0@lo:501: 00000100:00100000:0.0:1788844512.363154:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267855616:12345-0@lo:501: Request processed in 337us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.363171:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788844512.363389:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267855616:0@lo:501: 00000100:00100000:3.0:1788844512.363438:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267855744:0@lo:503: 00000100:00100000:3.0:1788844512.363491:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844512.363518:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788844512.363693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267855744 00000100:00100000:0.0:1788844512.363698:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267855744 00000100:00100000:0.0:1788844512.363720:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788844512.363726:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267855744:12345-0@lo:503: 00000100:00100000:0.0:1788844512.363872:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267855744:12345-0@lo:503: Request processed in 146us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.363878:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788844512.366895:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267855744:0@lo:503: 00000100:00100000:3.0:1788844512.371768:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8456:1875739267855872:0@lo:502: 00000100:00100000:3.0:1788844512.371866:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844512.371903:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788844512.372498:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267855872 00000100:00100000:0.0:1788844512.372506:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267855872 00000100:00100000:0.0:1788844512.372590:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788844512.372600:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:8456:x1875739267855872:12345-0@lo:502: 00000100:00100000:0.0:1788844512.372840:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:8456:x1875739267855872:12345-0@lo:502: Request processed in 241us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.372848:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788844512.372891:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8456:1875739267855872:0@lo:502: 00000020:01000000:2.0:1788844512.372932:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788844512.372941:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844512.372943:0:8456:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788844512.372955:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788844512.372985:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8456:1875739267856000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844512.373024:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844512.373055:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed0389840 going to sleep for 11 seconds 00000100:00100000:1.0:1788844512.373102:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267856000 00000100:00100000:1.0:1788844512.373112:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267856000 00000100:00100000:1.0:1788844512.373143:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788844512.373155:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:8456:x1875739267856000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844512.373292:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:8456:x1875739267856000:12345-0@lo:502:llog_process_th.0 Request processed in 142us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844512.373299:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788844512.373453:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8456:1875739267856000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788844512.373472:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788844512.373476:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844512.373478:0:8456:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788844512.373483:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788844512.373737:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788844512.373759:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788844512.373770:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.373797:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844512.373813:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788844512.373816:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eef3110000 from 39 10000000:01000000:1.0:1788844512.373821:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788844512.373853:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.373860:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.373876:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844512.373891:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267856128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.373925:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.373956:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1334780 going to sleep for 11 seconds 00000100:00100000:2.0:1788844512.374037:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267856128 00000100:00100000:2.0:1788844512.374042:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267856128 00000100:00100000:2.0:1788844512.374064:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788844512.374070:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:5836:x1875739267856128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844512.374079:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844512.374091:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d928f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9288 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.374113:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d928f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9288 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.374123:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d928f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9288 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.374132:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0205c400, rc 0) 00000100:00100000:2.0:1788844512.374183:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267856128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844512.374203:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788844512.374571:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267856128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844512.374597:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.374612:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844512.374682:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267856256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.374716:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.374750:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1334780 going to sleep for 11 seconds 00000100:00100000:3.0:1788844512.374883:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267856256 00000100:00100000:3.0:1788844512.374888:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267856256 00000100:00100000:3.0:1788844512.374924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788844512.374932:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267856256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844512.375176:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267856256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844512.375183:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788844512.375286:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267856256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.375330:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267856384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.375394:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.375418:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1334780 going to sleep for 11 seconds 00000100:00100000:0.0:1788844512.375526:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267856384 00000100:00100000:0.0:1788844512.375531:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267856384 00000100:00100000:0.0:1788844512.375571:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788844512.375578:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267856384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844512.375734:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267856384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.375741:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788844512.376106:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267856384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.384816:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8457:1875739267856512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844512.384916:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.384972:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1334780 going to sleep for 11 seconds 00000100:00100000:0.0:1788844512.385638:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267856512 00000100:00100000:0.0:1788844512.385647:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267856512 00000100:00100000:0.0:1788844512.385700:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788844512.385709:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:8457:x1875739267856512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788844512.385972:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:8457:x1875739267856512:12345-0@lo:502:llog_process_th.0 Request processed in 263us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.385980:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788844512.387971:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8457:1875739267856512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844512.388069:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8457:1875739267856640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844512.388141:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.388190:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec710db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788844512.388292:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267856640 00000100:00100000:2.0:1788844512.388299:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267856640 00000100:00100000:2.0:1788844512.388361:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788844512.388371:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:8457:x1875739267856640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844512.388634:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:8457:x1875739267856640:12345-0@lo:502:llog_process_th.0 Request processed in 263us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844512.388641:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788844512.388723:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8457:1875739267856640:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788844512.388745:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788844512.389039:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788844512.389058:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788844512.389068:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.389080:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844512.389089:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788844512.389092:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788844512.389095:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788844512.389123:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.389131:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.389141:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844512.389157:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5992680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267856768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788844512.389192:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844512.389236:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed56f1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844512.389322:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267856768 00000100:00100000:2.0:1788844512.389327:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267856768 00000100:00100000:2.0:1788844512.389369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788844512.389376:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:5836:x1875739267856768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844512.389385:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844512.389396:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d929d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9296 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.389417:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d929d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9296 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.389427:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d929d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9296 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.389435:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0205dc00, rc 0) 00000100:00100000:2.0:1788844512.389479:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267856768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844512.389485:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788844512.389954:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5992680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267856768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844512.389969:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.389979:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844512.390032:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267856896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.390063:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.390091:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1334780 going to sleep for 11 seconds 00000100:00100000:2.0:1788844512.390296:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267856896 00000100:00100000:2.0:1788844512.390313:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267856896 00000100:00100000:2.0:1788844512.390365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788844512.390372:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267856896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844512.390654:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267856896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844512.390661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788844512.390707:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267856896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.390741:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267857024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.390777:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.390806:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1334780 going to sleep for 11 seconds 00000100:00100000:0.0:1788844512.390857:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267857024 00000100:00100000:0.0:1788844512.390862:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267857024 00000100:00100000:0.0:1788844512.390893:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788844512.390908:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267857024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844512.391047:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267857024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.391053:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788844512.391121:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267857024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.391573:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8458:1875739267857152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844512.391611:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.391633:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1334780 going to sleep for 11 seconds 00000100:00100000:3.0:1788844512.392004:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267857152 00000100:00100000:3.0:1788844512.392010:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267857152 00000100:00100000:3.0:1788844512.392048:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788844512.392057:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:8458:x1875739267857152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844512.392248:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:8458:x1875739267857152:12345-0@lo:502:llog_process_th.0 Request processed in 191us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844512.392255:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788844512.392266:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8458:1875739267857152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788844512.392291:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844512.392300:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844512.392303:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788844512.392308:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788844512.392329:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8458:1875739267857280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844512.392376:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.392406:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eefaf009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844512.392460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267857280 00000100:00100000:3.0:1788844512.392464:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267857280 00000100:00100000:3.0:1788844512.392481:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788844512.392487:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:8458:x1875739267857280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844512.392636:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:8458:x1875739267857280:12345-0@lo:502:llog_process_th.0 Request processed in 147us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844512.392642:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788844512.392781:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8458:1875739267857280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788844512.392806:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844512.392810:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844512.392816:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788844512.392820:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788844512.393086:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788844512.393102:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788844512.393111:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.393122:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844512.393133:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788844512.393136:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eed0c68800 from 39 10000000:01000000:0.0:1788844512.393138:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788844512.393164:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.393172:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.393181:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844512.393196:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267857408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788844512.393239:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844512.393270:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed08c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788844512.393291:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267857408 00000100:00100000:1.0:1788844512.393296:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267857408 00000100:00100000:1.0:1788844512.393326:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788844512.393333:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267857408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844512.393349:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844512.393363:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99ba600/0x7f1093851e2d92ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d92a4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.393384:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99ba600/0x7f1093851e2d92ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d92a4 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.393394:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99ba600/0x7f1093851e2d92ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d92a4 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.393403:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99ba600, rc 0) 00000100:00100000:1.0:1788844512.393451:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267857408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844512.393466:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788844512.393802:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267857408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844512.393814:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.393823:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844512.393872:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267857536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844512.393900:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844512.393931:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844512.394045:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267857536 00000100:00100000:0.0:1788844512.394050:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267857536 00000100:00100000:0.0:1788844512.394083:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788844512.394089:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267857536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844512.394330:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267857536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.394350:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788844512.394664:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267857536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844512.394696:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267857664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844512.394732:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844512.394762:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844512.394843:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267857664 00000100:00100000:3.0:1788844512.394848:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267857664 00000100:00100000:3.0:1788844512.394879:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788844512.394885:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267857664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788844512.395042:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267857664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844512.395049:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788844512.395211:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267857664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844512.395765:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8459:1875739267857792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844512.395803:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844512.395831:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844512.396257:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267857792 00000100:00100000:3.0:1788844512.396264:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267857792 00000100:00100000:3.0:1788844512.396298:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788844512.396306:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:8459:x1875739267857792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844512.396937:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:8459:x1875739267857792:12345-0@lo:502:llog_process_th.0 Request processed in 630us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844512.396946:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788844512.401917:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8459:1875739267857792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844512.402029:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8459:1875739267857920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844512.402109:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844512.402145:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844512.402223:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267857920 00000100:00100000:0.0:1788844512.402244:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267857920 00000100:00100000:0.0:1788844512.402297:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788844512.402305:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:8459:x1875739267857920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788844512.402590:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:8459:x1875739267857920:12345-0@lo:502:llog_process_th.0 Request processed in 284us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.402598:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788844512.402886:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8459:1875739267857920:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788844512.402910:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788844512.403086:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788844512.403103:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788844512.403113:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.403123:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844512.403132:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788844512.403134:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788844512.403137:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788844512.403179:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.403187:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.403195:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844512.403211:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267858048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.403245:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.403276:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eefaf003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844512.403350:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267858048 00000100:00100000:2.0:1788844512.403355:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267858048 00000100:00100000:2.0:1788844512.403391:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788844512.403398:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267858048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844512.403408:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844512.403421:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ef0205ce00/0x7f1093851e2d92b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d92b2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.403443:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0205ce00/0x7f1093851e2d92b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d92b2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.403453:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ef0205ce00/0x7f1093851e2d92b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d92b2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844512.403471:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0205ce00, rc 0) 00000100:00100000:2.0:1788844512.403510:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267858048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844512.403516:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788844512.403563:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267858048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844512.403579:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.403599:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844512.403642:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267858176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.403667:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844512.403682:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eefaf003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844512.403729:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267858176 00000100:00100000:3.0:1788844512.403733:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267858176 00000100:00100000:3.0:1788844512.403764:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788844512.403771:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267858176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844512.404007:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267858176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844512.404014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788844512.404456:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267858176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844512.404501:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5992300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267858304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844512.404570:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844512.404586:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed08c93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844512.404998:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267858304 00000100:00100000:2.0:1788844512.405005:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267858304 00000100:00100000:2.0:1788844512.405042:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788844512.405050:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267858304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844512.405216:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267858304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844512.405223:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788844512.407288:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5992300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267858304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844512.409473:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5992300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8460:1875739267858432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788844512.409599:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844512.409636:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed08c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844512.410098:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267858432 00000100:00100000:1.0:1788844512.410105:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267858432 00000100:00100000:1.0:1788844512.410148:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788844512.410155:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8460:x1875739267858432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844512.410447:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8460:x1875739267858432:12345-0@lo:502:llog_process_th.0 Request processed in 281us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844512.410454:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788844512.410493:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5992300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8460:1875739267858432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788844512.410529:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788844512.410559:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844512.410561:0:8460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788844512.410573:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788844512.410600:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8460:1875739267858560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844512.410635:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844512.410667:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788844512.411747:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267858560 00000100:00100000:3.0:1788844512.411757:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267858560 00000100:00100000:3.0:1788844512.411789:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788844512.411797:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8460:x1875739267858560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844512.412003:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8460:x1875739267858560:12345-0@lo:502:llog_process_th.0 Request processed in 205us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844512.412010:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788844512.412253:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8460:1875739267858560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788844512.412282:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788844512.412288:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844512.412290:0:8460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788844512.412298:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788844512.414387:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788844512.414422:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788844512.414455:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844512.414466:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844512.414477:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788844512.414480:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91eed850cd28 from 1 10000000:01000000:3.0:1788844512.414483:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788844512.414519:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec13a1e00/0x7f1093851e2d92c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844512.414527:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec13a1e00/0x7f1093851e2d92c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844512.414573:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec13a1e00/0x7f1093851e2d92c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844512.414597:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267858688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788844512.414658:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844512.414695:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844512.414695:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267858688 00000100:00100000:0.0:1788844512.414703:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267858688 00000100:00100000:0.0:1788844512.414745:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788844512.414754:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267858688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844512.414766:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844512.414786:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5526800/0x7f1093851e2d92c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d92c0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.414812:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526800/0x7f1093851e2d92c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d92c0 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.414822:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5526800/0x7f1093851e2d92c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d92c0 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.414841:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526800, rc 0) 00000100:00100000:0.0:1788844512.414888:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267858688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.414894:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788844512.417316:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267858688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788844512.417356:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec13a1e00/0x7f1093851e2d92c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92c7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844512.417368:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec13a1e00/0x7f1093851e2d92c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d92c7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844512.417461:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267858816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844512.417529:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844512.417603:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844512.417682:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267858816 00000100:00100000:1.0:1788844512.417690:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267858816 00000100:00100000:1.0:1788844512.417729:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788844512.417738:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267858816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844512.417987:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267858816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (457us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788844512.417995:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788844512.418576:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267858816:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788844512.418609:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788844512.418617:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec13a1e00/0x7f1093851e2d92c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92c7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844512.418627:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec13a1e00/0x7f1093851e2d92c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92c7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.442500:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844512.716132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844512.716261:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244761856 00000100:00100000:0.0:1788844512.716276:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244761856 00000100:00100000:0.0:1788844512.716423:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 166 00000100:00100000:0.0:1788844512.716435:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:5599:x1875739244761856:12345-192.168.204.43@tcp:101: 00010000:00010000:0.0:1788844512.716458:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844512.716483:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5527400/0x7f1093851e2d92ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f85a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.716525:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5527400/0x7f1093851e2d92ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f85a expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.716572:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5527400/0x7f1093851e2d92ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f85a expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844512.716583:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527400, rc 0) 00000100:00100000:0.0:1788844512.716665:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5599:x1875739244761856:12345-192.168.204.43@tcp:101: Request processed in 232us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.716820:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 166 00000100:00100000:3.0:1788844512.723462:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844512.728088:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244761984 00000100:00100000:0.0:1788844512.728111:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244761984 00000100:00100000:0.0:1788844512.728220:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 167 00000100:00100000:0.0:1788844512.728232:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5599:x1875739244761984:12345-192.168.204.43@tcp:501: 00000100:00100000:0.0:1788844512.728745:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5599:x1875739244761984:12345-192.168.204.43@tcp:501: Request processed in 512us (5297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.728757:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 167 00000100:00100000:3.0:1788844512.735519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844512.735780:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244762112 00000100:00100000:1.0:1788844512.735794:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244762112 00000100:00100000:1.0:1788844512.735865:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 168 00000100:00100000:1.0:1788844512.735878:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5599:x1875739244762112:12345-192.168.204.43@tcp:503: 00000100:00100000:1.0:1788844512.736216:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5599:x1875739244762112:12345-192.168.204.43@tcp:503: Request processed in 339us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844512.736224:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 168 00000100:00100000:1.0:1788844512.752524:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844512.752825:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244762240 00000100:00100000:3.0:1788844512.752839:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244762240 00000100:00100000:3.0:1788844512.752923:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 169 00000100:00100000:3.0:1788844512.752936:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:6072:x1875739244762240:12345-192.168.204.43@tcp:502: 00000100:00100000:3.0:1788844512.753313:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:6072:x1875739244762240:12345-192.168.204.43@tcp:502: Request processed in 379us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844512.753324:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 169 00000100:00100000:3.0:1788844512.757494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844512.757649:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244762368 00000100:00100000:0.0:1788844512.757662:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244762368 00000100:00100000:0.0:1788844512.757743:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 170 00000100:00100000:0.0:1788844512.757755:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:6072:x1875739244762368:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788844512.758135:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:6072:x1875739244762368:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 380us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844512.758144:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 170 00000100:00100000:0.0:1788844512.778161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844512.780678:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244762496 00000100:00100000:1.0:1788844512.780709:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244762496 00000100:00100000:1.0:1788844512.780806:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 171 00000100:00100000:1.0:1788844512.781218:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5599:x1875739244762496:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844512.781243:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844512.781276:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bb200/0x7f1093851e2d92d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f861 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.781318:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bb200/0x7f1093851e2d92d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f861 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.781339:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bb200/0x7f1093851e2d92d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f861 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844512.781351:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bb200, rc 0) 00000100:00100000:1.0:1788844512.781453:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5599:x1875739244762496:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 637us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844512.781462:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 171 00000100:00100000:1.0:1788844512.789388:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844512.792009:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244762624 00000100:00100000:3.0:1788844512.792036:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244762624 00000100:00100000:3.0:1788844512.792139:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 172 00000100:00100000:3.0:1788844512.792152:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5599:x1875739244762624:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844512.792677:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5599:x1875739244762624:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 524us (3304us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788844512.792705:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 172 00010000:00010000:3.0:1788844513.466633:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844514.490745:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844514.559082:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844514.559114:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267858944:0@lo:400:kworker.0 00000100:00100000:1.0:1788844514.559240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844514.559344:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267858944 00000100:00100000:1.0:1788844514.559363:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267858944 00000100:00100000:1.0:1788844514.559421:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788844514.559433:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267858944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844514.559498:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267858944:12345-0@lo:400:kworker.0 Request processed in 67us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844514.559507:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788844514.559595:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267858944:0@lo:400:kworker.0 00000100:00100000:2.0:1788844514.562125:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267859072:0@lo:400:kworker.0 00000100:00100000:2.0:1788844514.562243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844514.562303:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267859584:0@lo:400:kworker.0 00000100:00100000:2.0:1788844514.562338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844514.562368:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844514.562375:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267859200:0@lo:400:kworker.0 00000100:00100000:2.0:1788844514.562398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844514.562439:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267859072 00000100:00100000:2.0:1788844514.562459:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267859072 00000100:00100000:2.0:1788844514.562513:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267859200 00000100:00100000:2.0:1788844514.562524:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267859200 00000100:00100000:2.0:1788844514.562588:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788844514.562599:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267859072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844514.562662:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267859072:12345-0@lo:400:kworker.0 Request processed in 65us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844514.562670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788844514.562695:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788844514.562700:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267859200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844514.562726:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267859200:12345-0@lo:400:kworker.0 Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844514.562731:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788844514.562749:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267859584 00000100:00100000:2.0:1788844514.562752:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267859584 00000100:00100000:2.0:1788844514.562777:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788844514.562783:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267859584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844514.562811:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267859584:12345-0@lo:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844514.562818:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788844514.562839:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788844514.562844:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844514.562877:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267859200:0@lo:400:kworker.0 00000100:00100000:2.0:1788844514.562888:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267859072:0@lo:400:kworker.0 00010000:00080000:2.0:1788844514.562899:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8569500 x1875739267859584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844514.562909:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267859584:0@lo:400:kworker.0 00000100:00100000:1.0:1788844514.574259:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267859456:0@lo:400:kworker.0 00000100:00100000:1.0:1788844514.574370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844514.574431:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788844514.574438:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267859328:0@lo:400:kworker.0 00000100:00100000:1.0:1788844514.574464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844514.574503:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267859456 00000100:00100000:1.0:1788844514.574513:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267859456 00000100:00100000:1.0:1788844514.574621:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788844514.574631:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267859456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844514.574692:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267859456:12345-0@lo:400:kworker.0 Request processed in 62us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844514.574700:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788844514.574724:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267859328 00000100:00100000:1.0:1788844514.574727:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267859328 00000100:00100000:1.0:1788844514.574763:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788844514.574769:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267859328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844514.574797:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267859328:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844514.574802:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788844514.574833:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788844514.574838:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788844514.574872:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8568e00 x1875739267859328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844514.574889:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267859328:0@lo:400:kworker.0 00000100:00100000:1.0:1788844514.574900:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267859456:0@lo:400:kworker.0 00000100:00100000:3.0:1788844515.068891:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267859712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844515.069293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844515.070182:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267859712 00000100:00100000:3.0:1788844515.070199:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267859712 00000100:00100000:3.0:1788844515.070268:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788844515.070279:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267859712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844515.070336:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844515.071929:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267859712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1639us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844515.071944:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788844515.072036:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed856b800 x1875739267859712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844515.072063:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267859712:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788844515.144398:0:8500:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc81121130 20000000:00000080:1.0:1788844515.144426:0:8500:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91ef0162f000 uarg=0000000000000000 20000000:01000000:1.0:1788844515.144479:0:8500:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788844515.144487:0:8500:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788844515.144494:0:8500:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788844515.146315:0:8501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788844515.147006:0:8500:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788844515.154236:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788844515.154313:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788844515.154376:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788844515.154397:0:8500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788844515.154427:0:8500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844515.154450:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d9051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d904a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844515.154460:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed99bb800/0x7f1093851e2d90b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d90ac expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844515.154467:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d917e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9177 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844515.154478:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0024200/0x7f1093851e2d923b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f829 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844515.154503:0:8500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844515.154600:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0024200/0x7f1093851e2d923b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f829 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844515.154622:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eec0024200/0x7f1093851e2d923b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f829 expref: 9 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844515.154643:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb396d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875739267859840:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844515.155073:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d917e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d9177 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844515.155083:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d917e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d9177 expref: 18 pid: 5831 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844515.155094:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb395180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875739267859968:0@lo:104: 00000100:00100000:1.0:1788844515.155150:0:8500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788844515.155203:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed99bb800/0x7f1093851e2d90b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d90ac expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844515.155212:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eed99bb800/0x7f1093851e2d90b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d90ac expref: 18 pid: 5831 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844515.155221:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb396a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875739267860096:0@lo:104: 00000100:00100000:1.0:1788844515.155248:0:8500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788844515.155273:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d9051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d904a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844515.155305:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d9051 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d904a expref: 18 pid: 5834 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844515.155314:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb396680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875739267860224:0@lo:104: 00000100:00100000:1.0:1788844515.155335:0:8500:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844515.155732:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788844515.155758:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844515.155789:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267859968 00000100:00100000:3.0:1788844515.155799:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267859968 00000100:00100000:3.0:1788844515.155851:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267860096 00000100:00100000:3.0:1788844515.155854:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267860096 00000100:00100000:3.0:1788844515.155865:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267860224 00000100:00100000:3.0:1788844515.155867:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267860224 00000100:00100000:3.0:1788844515.155882:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788844515.155891:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:8500:x1875739267859968:12345-0@lo:104: 00010000:00010000:3.0:1788844515.155906:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.155979:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788844515.155986:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:8500:x1875739267859968:12345-0@lo:104: Request processed in 96us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844515.155994:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788844515.156015:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788844515.156021:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec71cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:8500:x1875739267860096:12345-0@lo:104: 00010000:00010000:3.0:1788844515.156027:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156056:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788844515.156060:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec71cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:8500:x1875739267860096:12345-0@lo:104: Request processed in 41us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844515.156066:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788844515.156100:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788844515.156105:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:8500:x1875739267860224:12345-0@lo:104: 00010000:00010000:3.0:1788844515.156112:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec5526c00/0x7f1093851e2d904a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156132:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788844515.156136:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:8500:x1875739267860224:12345-0@lo:104: Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844515.156141:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788844515.156157:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788844515.156164:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156170:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024c00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844515.156181:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156191:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844515.156199:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844515.156206:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788844515.156244:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156251:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844515.156276:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156295:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0024c00/0x7f1093851e2d9177 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d917e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156311:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788844515.156314:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156320:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526400 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844515.156323:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156330:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844515.156348:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844515.156353:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788844515.156368:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156374:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844515.156380:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156387:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2d90ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d90b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156397:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844515.156400:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec5526c00/0x7f1093851e2d904a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156405:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526c00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844515.156408:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec5526c00/0x7f1093851e2d904a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156414:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec5526c00/0x7f1093851e2d904a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844515.156421:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec5526c00/0x7f1093851e2d904a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844515.156426:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788844515.156445:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec5526c00/0x7f1093851e2d904a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156450:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844515.156465:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec5526c00/0x7f1093851e2d904a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156472:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec5526c00/0x7f1093851e2d904a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9051 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156486:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844515.156488:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844515.156490:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844515.156497:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844515.156520:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267860352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788844515.156589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844515.156620:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844515.156625:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267860480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788844515.156647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844515.156678:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267860608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788844515.156700:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844515.156738:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267860352 00000100:00100000:3.0:1788844515.156745:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267860352 00010000:00010000:3.0:1788844515.156773:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d917e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9177 expref: 19 pid: 5831 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844515.156792:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267860480 00000100:00100000:3.0:1788844515.156795:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267860480 00010000:00010000:3.0:1788844515.156805:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed99bb800/0x7f1093851e2d90b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d90ac expref: 20 pid: 5831 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844515.156827:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267860608 00000100:00100000:3.0:1788844515.156830:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267860608 00010000:00010000:3.0:1788844515.156841:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d9051 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d904a expref: 21 pid: 5834 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844515.156853:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788844515.156859:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+21:3305:x1875739267860352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788844515.156871:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844515.156877:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d917e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9177 expref: 21 pid: 5831 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156886:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d917e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d9177 expref: 21 pid: 5831 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156907:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844515.156936:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+21:3305:x1875739267860352:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844515.156943:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788844515.156958:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788844515.156964:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+20:3305:x1875739267860480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788844515.156972:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844515.156976:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed99bb800/0x7f1093851e2d90b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d90ac expref: 20 pid: 5831 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156985:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed99bb800/0x7f1093851e2d90b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d90ac expref: 20 pid: 5831 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.156995:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844515.157022:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+20:3305:x1875739267860480:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844515.157028:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788844515.157040:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788844515.157046:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267860608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788844515.157053:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844515.157057:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d9051 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d904a expref: 19 pid: 5834 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.157065:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d9051 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d904a expref: 19 pid: 5834 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.157075:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844515.157099:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267860608:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844515.157105:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788844515.157152:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267860608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788844515.157185:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267860480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788844515.157193:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267860352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788844515.157515:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d917e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d9177 expref: 18 pid: 5831 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844515.157532:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb395180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875739267859968:0@lo:104: 00010000:00010000:1.0:1788844515.157567:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bb800/0x7f1093851e2d90b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d90ac expref: 17 pid: 5831 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844515.157575:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb396a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875739267860096:0@lo:104: 00010000:00010000:1.0:1788844515.157585:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d9051 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d904a expref: 16 pid: 5834 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844515.157594:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb396680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875739267860224:0@lo:104: 00000100:00100000:0.0:1788844515.161245:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb396d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1875739267859840:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844515.161321:0:8500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844515.163106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844515.164470:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244762752 00000100:00100000:3.0:1788844515.164494:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244762752 00010000:00010000:3.0:1788844515.164791:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0024200/0x7f1093851e2d923b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f829 expref: 10 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844515.164885:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:3.0:1788844515.164898:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244762752:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844515.164917:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844515.164953:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0024200/0x7f1093851e2d923b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f829 expref: 10 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.164966:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0024200/0x7f1093851e2d923b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f829 expref: 10 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.164989:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0024200/0x7f1093851e2d923b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f829 expref: 10 pid: 5833 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.165008:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.165018:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.165037:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.165043:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.165050:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.165056:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.165063:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed99ba800 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844515.165068:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.165077:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.165118:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.165140:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844515.165371:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:2354:x1875739244762752:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 474us (2279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844515.165381:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 24 00010000:00010000:0.0:1788844515.165574:0:8500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844515.165585:0:8500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844515.165603:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99ba800/0x7f1093851e2d92dc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844515.518046:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844515.587798:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267860736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844515.587934:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844515.588394:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267860736 00000100:00100000:1.0:1788844515.588406:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267860736 00000100:00100000:1.0:1788844515.588466:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788844515.588476:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267860736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788844515.588525:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844515.588614:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267860736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844515.588621:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788844515.588691:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb396300 x1875739267860736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844515.588712:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267860736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844515.779755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844515.779818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844515.779872:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844515.779968:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244763136 00000100:00100000:0.0:1788844515.779981:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244763136 00000100:00100000:2.0:1788844515.780031:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244762880 00000100:00100000:2.0:1788844515.780035:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244762880 00000100:00100000:0.0:1788844515.780076:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244763008 00000100:00100000:2.0:1788844515.780079:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:0.0:1788844515.780079:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244763008 00000100:00100000:2.0:1788844515.780090:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244762880:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844515.780102:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:0.0:1788844515.780109:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244763136:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:1.0:1788844515.780183:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844515.780187:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244762880:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 98us (450us total) trans 0 rc 0/0 00000100:00080000:1.0:1788844515.780189:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788844515.780191:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788844515.780206:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:2.0:1788844515.780208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:1.0:1788844515.780213:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244763008:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844515.795711:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244763136:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 15580us (15870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844515.795732:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:1.0:1788844515.796000:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244763008:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 15784us (16124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844515.796010:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 10000000:01000000:3.0:1788844516.281906:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788844516.281918:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eefacdc000 from 4 10000000:01000000:3.0:1788844516.281925:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788844516.282001:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844516.282016:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844516.282041:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844516.282077:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267860864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788844516.282176:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844516.282245:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788844516.282570:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267860864 00000100:00100000:0.0:1788844516.282581:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267860864 00000100:00100000:0.0:1788844516.282649:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788844516.282661:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267860864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844516.282679:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844516.282697:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5526e00/0x7f1093851e2d92ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d92e3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844516.282726:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526e00/0x7f1093851e2d92ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d92e3 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844516.282738:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5526e00/0x7f1093851e2d92ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d92e3 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844516.282749:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526e00, rc 0) 00000100:00100000:0.0:1788844516.282808:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267860864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844516.282836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788844516.285221:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267860864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788844516.285276:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844516.285299:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844516.285437:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267860992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844516.285519:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844516.285742:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788844516.297792:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267860992 00000100:00100000:1.0:1788844516.297813:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267860992 00000100:00100000:1.0:1788844516.297906:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788844516.297918:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267860992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844516.299193:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267860992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 620us (13017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844516.299211:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788844516.299808:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267860992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844516.299998:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb396680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267861120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844516.300165:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844516.300602:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788844516.315731:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267861120 00000100:00100000:3.0:1788844516.315756:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267861120 00000100:00100000:3.0:1788844516.315835:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788844516.315847:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267861120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788844516.316275:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267861120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 429us (16108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844516.316284:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788844516.316382:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb396680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267861120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788844516.316750:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8521:1875739267861248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844516.316808:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844516.316844:0:8521:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1240 going to sleep for 11 seconds 00000100:00100000:1.0:1788844516.317110:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267861248 00000100:00100000:1.0:1788844516.317119:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267861248 00000100:00100000:1.0:1788844516.317155:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788844516.317163:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:8521:x1875739267861248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844516.317407:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:8521:x1875739267861248:12345-0@lo:502:llog_process_th.0 Request processed in 242us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844516.317414:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788844516.318576:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8521:1875739267861248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788844516.318646:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844516.318664:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844516.318667:0:8521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788844516.318678:0:8521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eefacdc000 00000020:00000080:3.0:1788844516.318681:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788844516.318793:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8521:1875739267861376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844516.318872:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844516.318914:0:8521:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1240 going to sleep for 11 seconds 00000100:00100000:1.0:1788844516.321893:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267861376 00000100:00100000:1.0:1788844516.321916:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267861376 00000100:00100000:1.0:1788844516.322000:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788844516.322012:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:8521:x1875739267861376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844516.322381:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:8521:x1875739267861376:12345-0@lo:502:llog_process_th.0 Request processed in 370us (3507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844516.322390:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788844516.323034:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8521:1875739267861376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788844516.323105:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844516.323116:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844516.323118:0:8521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788844516.323127:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788844516.330273:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788844516.330317:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788844516.330332:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844516.330348:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844516.330361:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788844516.330364:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eef3110000 from 4 10000000:01000000:1.0:1788844516.330367:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788844516.330414:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844516.330422:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844516.330445:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844516.330476:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267861504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788844516.334408:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844516.334482:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532000 going to sleep for 11 seconds 00000100:00100000:1.0:1788844516.334556:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267861504 00000100:00100000:1.0:1788844516.334569:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267861504 00000100:00100000:1.0:1788844516.334632:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788844516.334643:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267861504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844516.334664:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844516.334691:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d92f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d92f1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844516.334729:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d92f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d92f1 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844516.334742:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d92f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d92f1 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844516.334751:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bbe00, rc 0) 00000100:00100000:1.0:1788844516.334814:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267861504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844516.334821:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788844516.334896:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267861504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844516.334918:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844516.334944:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844516.335292:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267861632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844516.335336:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844516.335371:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532000 going to sleep for 11 seconds 00000100:00100000:2.0:1788844516.335848:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267861632 00000100:00100000:2.0:1788844516.335858:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267861632 00000100:00100000:2.0:1788844516.335901:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788844516.335910:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267861632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844516.336282:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267861632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 372us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844516.336291:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788844516.337889:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267861632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844516.337974:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267861760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844516.338186:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844516.338236:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532000 going to sleep for 11 seconds 00000100:00100000:2.0:1788844516.338694:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267861760 00000100:00100000:2.0:1788844516.338705:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267861760 00000100:00100000:2.0:1788844516.338766:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788844516.338777:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267861760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844516.339188:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267861760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 411us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844516.339196:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788844516.339274:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267861760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844516.339939:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8523:1875739267861888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844516.340003:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844516.340146:0:8523:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788844516.348984:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267861888 00000100:00100000:1.0:1788844516.349008:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267861888 00000100:00100000:1.0:1788844516.350404:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788844516.350431:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8523:x1875739267861888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844516.350814:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8523:x1875739267861888:12345-0@lo:502:llog_process_th.0 Request processed in 394us (10809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844516.350824:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788844516.351829:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8523:1875739267861888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788844516.351891:0:8523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844516.351906:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844516.351909:0:8523:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788844516.351920:0:8523:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eef3110000 00000020:00000080:3.0:1788844516.351923:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788844516.352049:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8523:1875739267862016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844516.352121:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844516.358519:0:8523:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788844516.361197:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267862016 00000100:00100000:2.0:1788844516.361219:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267862016 00000100:00100000:2.0:1788844516.361784:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788844516.361799:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8523:x1875739267862016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844516.364479:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:8523:x1875739267862016:12345-0@lo:502:llog_process_th.0 Request processed in 2670us (12343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844516.364497:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788844516.364711:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8523:1875739267862016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788844516.364764:0:8523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844516.364775:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844516.364778:0:8523:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788844516.364786:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788844516.365226:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788844516.365266:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788844516.365280:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844516.365343:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844516.365357:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788844516.365360:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eed0c68800 from 4 10000000:01000000:2.0:1788844516.365363:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788844516.365407:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844516.365416:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844516.365427:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844516.365465:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb392300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267862144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788844516.365528:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844516.366054:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788844516.366092:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267862144 00000100:00100000:2.0:1788844516.366101:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267862144 00000100:00100000:3.0:1788844516.369786:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788844516.370821:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267862144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844516.370861:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844516.370889:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5527a00/0x7f1093851e2d9306 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d92ff expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844516.370929:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5527a00/0x7f1093851e2d9306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d92ff expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844516.370943:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5527a00/0x7f1093851e2d9306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d92ff expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844516.370952:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527a00, rc 0) 00000100:00100000:0.0:1788844516.371280:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267862144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1477us (5752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844516.371438:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb392300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267862144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844516.371462:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844516.371473:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844516.371619:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb392300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267862272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844516.371669:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844516.371707:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788844516.371729:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267862272 00000100:00100000:2.0:1788844516.371736:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267862272 00000100:00100000:0.0:1788844516.371803:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788844516.372767:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788844516.372787:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267862272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844516.375332:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267862272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2537us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844516.375349:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788844516.379447:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb392300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267862272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844516.379752:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb395180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267862400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844516.379997:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844516.380743:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee0532cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844516.382013:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267862400 00000100:00100000:2.0:1788844516.382160:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267862400 00000100:00100000:2.0:1788844516.382245:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788844516.382267:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267862400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844516.382627:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267862400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 372us (2629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844516.382636:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788844516.384297:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb395180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267862400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844516.385984:0:8526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb395180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8526:1875739267862528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844516.386185:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844516.386233:0:8526:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee05326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844516.386587:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267862528 00000100:00100000:2.0:1788844516.386600:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267862528 00000100:00100000:2.0:1788844516.386664:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788844516.386675:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:8526:x1875739267862528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844516.386982:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:8526:x1875739267862528:12345-0@lo:502:llog_process_th.0 Request processed in 308us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844516.386992:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788844516.389412:0:8526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb395180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8526:1875739267862528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788844516.389477:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844516.389492:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844516.389495:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788844516.389505:0:8526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eed0c68800 00000020:00000080:1.0:1788844516.389508:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788844516.389658:0:8526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb395180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8526:1875739267862656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844516.389749:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844516.400281:0:8526:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee05326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844516.400627:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267862656 00000100:00100000:3.0:1788844516.400642:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267862656 00000100:00100000:3.0:1788844516.400763:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788844516.400774:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:8526:x1875739267862656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844516.401159:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:8526:x1875739267862656:12345-0@lo:502:llog_process_th.0 Request processed in 385us (11409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844516.401170:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788844516.406591:0:8526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb395180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:8526:1875739267862656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788844516.406658:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844516.406671:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844516.406674:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788844516.406679:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788844516.406786:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788844516.406809:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788844516.406824:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844516.406838:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844516.539136:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844516.994799:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844516.995243:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244763264 00000100:00100000:3.0:1788844516.995283:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244763264 00000100:00100000:3.0:1788844516.995360:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 189 00000100:00100000:3.0:1788844516.995371:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:5599:x1875739244763264:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788844516.995395:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844516.995423:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec13a0e00/0x7f1093851e2d930d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f868 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844516.995462:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec13a0e00/0x7f1093851e2d930d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f868 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844516.995475:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec13a0e00/0x7f1093851e2d930d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f868 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844516.995485:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec13a0e00, rc 0) 00000100:00100000:3.0:1788844516.995594:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5599:x1875739244763264:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 224us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844516.995601:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 189 00000100:00100000:0.0:1788844516.998665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844516.998772:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244763392 00000100:00100000:2.0:1788844516.998787:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244763392 00000100:00100000:2.0:1788844516.998868:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 190 00000100:00100000:2.0:1788844516.998879:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5599:x1875739244763392:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844516.999296:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5599:x1875739244763392:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 417us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844516.999304:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 190 00000100:00100000:2.0:1788844517.010059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844517.010118:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244763520 00000100:00100000:2.0:1788844517.010130:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244763520 00000100:00100000:2.0:1788844517.010192:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 191 00000100:00100000:2.0:1788844517.010204:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5599:x1875739244763520:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844517.010517:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:5599:x1875739244763520:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 313us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844517.010526:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 191 00000100:00100000:3.0:1788844517.014372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844517.015111:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244763648 00000100:00100000:2.0:1788844517.015127:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244763648 00000100:00100000:2.0:1788844517.015216:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 192 00000100:00100000:2.0:1788844517.015228:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:6129:x1875739244763648:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788844517.015621:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:6129:x1875739244763648:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 392us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844517.015630:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 192 00000100:00100000:2.0:1788844517.029673:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844517.030071:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244763776 00000100:00100000:1.0:1788844517.030085:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244763776 00000100:00100000:1.0:1788844517.030164:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 193 00000100:00100000:1.0:1788844517.030176:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:6129:x1875739244763776:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788844517.030565:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:6129:x1875739244763776:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 364us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844517.030574:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 193 00010000:00010000:3.0:1788844517.562964:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844518.589389:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844519.613067:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844519.674652:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267863168:0@lo:400:kworker.0 00000100:00100000:2.0:1788844519.674758:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844519.675507:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267862784:0@lo:400:kworker.0 00000100:00100000:3.0:1788844519.675637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844519.675698:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267863296:0@lo:400:kworker.0 00000100:00100000:3.0:1788844519.675729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844519.675769:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788844519.675777:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb392a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267862912:0@lo:400:kworker.0 00000100:00100000:3.0:1788844519.675804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844519.675847:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267863424:0@lo:400:kworker.0 00000100:00100000:3.0:1788844519.675874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844519.675915:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267863040:0@lo:400:kworker.0 00000100:00100000:3.0:1788844519.675940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844519.675991:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267863168 00000100:00100000:3.0:1788844519.676002:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267863168 00000100:00100000:2.0:1788844519.676235:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267863296 00000100:00100000:2.0:1788844519.676241:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267863296 00000100:00100000:2.0:1788844519.676281:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267862912 00000100:00100000:2.0:1788844519.676284:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267862912 00000100:00100000:2.0:1788844519.676307:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267863040 00000100:00100000:2.0:1788844519.676312:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267863040 00000100:00100000:2.0:1788844519.676344:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788844519.676358:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267863296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844519.676438:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267863296:12345-0@lo:400:kworker.0 Request processed in 84us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844519.676447:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788844519.676475:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788844519.676483:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267862912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844519.676518:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267862912:12345-0@lo:400:kworker.0 Request processed in 37us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844519.676525:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788844519.676563:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788844519.676580:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267863040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844519.676620:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267863040:12345-0@lo:400:kworker.0 Request processed in 42us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844519.676626:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788844519.676655:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267862784 00000100:00100000:2.0:1788844519.676660:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267862784 00000100:00100000:2.0:1788844519.676694:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788844519.676701:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267862784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844519.676734:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267862784:12345-0@lo:400:kworker.0 Request processed in 34us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844519.676740:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788844519.676918:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267863424 00000100:00100000:2.0:1788844519.676924:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267863424 00000100:00100000:2.0:1788844519.676956:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788844519.676963:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb393480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267863168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844519.677005:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb393480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267863168:12345-0@lo:400:kworker.0 Request processed in 42us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844519.677011:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788844519.677027:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788844519.677033:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267863424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844519.677062:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267863424:12345-0@lo:400:kworker.0 Request processed in 29us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844519.677068:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788844519.677319:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267863040:0@lo:400:kworker.0 00000100:00100000:3.0:1788844519.677369:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb392a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267862912:0@lo:400:kworker.0 00010000:00080000:3.0:1788844519.677385:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb390700 x1875739267863424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844519.677398:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267863424:0@lo:400:kworker.0 00000100:00100000:3.0:1788844519.677410:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267862784:0@lo:400:kworker.0 00000100:00100000:3.0:1788844519.677429:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267863296:0@lo:400:kworker.0 00010000:00080000:3.0:1788844519.680338:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb393b80 x1875739267863168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844519.680362:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267863168:0@lo:400:kworker.0 00000100:00080000:2.0:1788844519.680810:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788844519.680819:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788844519.680822:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788844520.186284:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267863552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844520.186387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844520.186492:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267863552 00000100:00100000:0.0:1788844520.186502:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267863552 00000100:00100000:0.0:1788844520.187052:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788844520.187065:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267863552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788844520.187114:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844520.187194:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267863552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844520.187212:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788844520.189934:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec5990380 x1875739267863552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844520.189984:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267863552:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788844520.641984:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844520.708982:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788844520.718223:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267863680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844520.718336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844520.722958:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267863680 00000100:00100000:2.0:1788844520.722982:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267863680 00000100:00100000:2.0:1788844520.723085:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788844520.723099:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267863680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844520.723150:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844520.723285:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267863680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (4949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844520.723293:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788844520.723365:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed84d5f80 x1875739267863680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844520.723391:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267863680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844520.907747:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844520.907930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844520.907976:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844520.908006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844520.908044:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244763904 00000100:00100000:3.0:1788844520.908073:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244763904 00000100:00100000:3.0:1788844520.908144:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 195 00000100:00100000:3.0:1788844520.908156:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244763904:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844520.908726:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244763904:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 567us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844520.908738:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 195 00000100:00100000:3.0:1788844520.908946:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244764288 00000100:00100000:3.0:1788844520.908954:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244764288 00000100:00100000:3.0:1788844520.909004:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244764160 00000100:00100000:3.0:1788844520.909007:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244764160 00000100:00100000:3.0:1788844520.909031:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:3.0:1788844520.909039:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244764288:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844520.909085:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244764288:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 46us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844520.909092:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:3.0:1788844520.909104:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:3.0:1788844520.909111:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244764160:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844520.909135:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244764160:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 25us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844520.909142:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00080000:0.0:1788844520.910398:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844520.910412:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788844520.912428:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244764032 00000100:00100000:1.0:1788844520.912620:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244764032 00000100:00100000:1.0:1788844520.912812:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:1.0:1788844520.914273:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244764032:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844520.914406:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244764032:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 1583us (6674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844520.914418:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00080000:0.0:1788844520.917571:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788844521.664944:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844522.687500:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844523.708639:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844524.735059:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844524.795128:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267863808:0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.795230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844524.795295:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267864320:0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.795325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844524.795358:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788844524.795365:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267863936:0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.795389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844524.795408:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267864448:0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.795436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844524.795469:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267864064:0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.795495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844524.795520:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844524.795525:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267864192:0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.795567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844524.795798:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267863808 00000100:00100000:2.0:1788844524.795810:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267863808 00000100:00100000:2.0:1788844524.796090:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788844524.796112:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267863808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844524.796186:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267863808:12345-0@lo:400:kworker.0 Request processed in 78us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844524.796195:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788844524.797376:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267864320 00000100:00100000:0.0:1788844524.797394:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267864320 00000100:00100000:0.0:1788844524.797463:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267863936 00000100:00100000:0.0:1788844524.797467:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267863936 00000100:00100000:0.0:1788844524.797481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267864064 00000100:00100000:0.0:1788844524.797484:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267864064 00000100:00100000:0.0:1788844524.797502:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788844524.797511:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267864320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.797626:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267864320:12345-0@lo:400:kworker.0 Request processed in 115us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844524.797634:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788844524.797653:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788844524.797659:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267863936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.797682:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267863936:12345-0@lo:400:kworker.0 Request processed in 24us (2293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844524.797688:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788844524.797698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788844524.797703:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267864064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.797731:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267864064:12345-0@lo:400:kworker.0 Request processed in 28us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844524.797735:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788844524.797758:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267864448 00000100:00100000:0.0:1788844524.797762:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267864448 00000100:00100000:0.0:1788844524.797786:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267864192 00000100:00100000:0.0:1788844524.797790:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267864192 00000100:00100000:0.0:1788844524.797808:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788844524.797814:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267864448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.797841:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267864448:12345-0@lo:400:kworker.0 Request processed in 28us (2406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844524.797846:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788844524.797856:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788844524.797862:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5991880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267864192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.797884:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5991880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267864192:12345-0@lo:400:kworker.0 Request processed in 23us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844524.797899:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788844524.797926:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844524.797931:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844524.797934:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844524.797997:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267863936:0@lo:400:kworker.0 00010000:00080000:0.0:1788844524.798018:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec5993480 x1875739267864448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844524.798031:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267864448:0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.798043:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267863808:0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.798055:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267864320:0@lo:400:kworker.0 00010000:00080000:0.0:1788844524.798118:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec5993100 x1875739267864192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844524.798128:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267864192:0@lo:400:kworker.0 00000100:00100000:0.0:1788844524.798141:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267864064:0@lo:400:kworker.0 00000001:02000400:3.0:1788844524.888378:0:8800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1788844525.316875:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267864576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844525.316974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844525.317338:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267864576 00000100:00100000:1.0:1788844525.317350:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267864576 00000100:00100000:1.0:1788844525.317412:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788844525.321317:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267864576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844525.321390:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844525.322899:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267864576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5465us (5914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844525.322917:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788844525.323940:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb395180 x1875739267864576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844525.323973:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267864576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788844525.760589:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844525.820267:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267864704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844525.820379:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844525.821031:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267864704 00000100:00100000:2.0:1788844525.821045:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267864704 00000100:00100000:2.0:1788844525.821126:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788844525.821139:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267864704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844525.821189:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844525.821268:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267864704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844525.821276:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788844525.821404:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb390000 x1875739267864704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844525.821429:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267864704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844526.024425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844526.024788:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844526.024880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844526.025085:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244764672 00000100:00100000:1.0:1788844526.025099:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244764672 00000100:00100000:1.0:1788844526.025187:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:1.0:1788844526.025200:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2353:x1875739244764672:12345-192.168.204.43@tcp:9:kworker.0 00000020:00000080:1.0:1788844526.025265:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9249 00000100:00080000:1.0:1788844526.025278:0:6686:0:(import.c:65:import_set_state_nolock()) ffff91eec71b7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788844526.025325:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788844526.025827:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+2:2353:x1875739244764672:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 626us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844526.025836:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00080000:1.0:1788844526.025865:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788844526.025919:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844526.026331:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244764416 00000100:00100000:2.0:1788844526.026341:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244764416 00000100:00100000:2.0:1788844526.026387:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 197 00000100:00100000:2.0:1788844526.026397:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2355:x1875739244764416:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844526.026443:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2355:x1875739244764416:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 48us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844526.026451:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 197 00000100:00100000:3.0:1788844526.026836:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844526.026937:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244764800 00000100:00100000:2.0:1788844526.026944:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244764800 00000100:00100000:2.0:1788844526.027004:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:2.0:1788844526.027012:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2353:x1875739244764800:12345-192.168.204.43@tcp:9:kworker.0 00000020:00000080:2.0:1788844526.027050:0:7066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9250 00000100:00080000:2.0:1788844526.027062:0:7066:0:(import.c:65:import_set_state_nolock()) ffff91eec5755800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788844526.027114:0:7066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788844526.027505:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+2:2353:x1875739244764800:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 491us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844526.027513:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00010000:00010000:2.0:1788844526.027573:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788844526.031108:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788844526.031347:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244764544 00000100:00100000:0.0:1788844526.031363:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244764544 00000100:00080000:1.0:1788844526.032042:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844526.032111:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:3.0:1788844526.032129:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244764544:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844526.032820:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244764544:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 692us (8028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844526.032832:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00010000:00010000:2.0:1788844526.777858:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844527.802267:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788844528.510225:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:0.0:1788844528.510239:0:6711:0:(genops.c:885:class_export_put()) final put ffff91eec71b6000/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:1.0:1788844528.510308:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec71b6000/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 for lustre-OST0000 00000020:00000080:1.0:1788844528.510374:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec71b7800 for lustre-OST0000 00010000:00010000:2.0:1788844528.832136:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844529.849738:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844529.913865:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267864960:0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.913982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844529.914060:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267865472:0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.914090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844529.914130:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788844529.914135:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267864832:0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.914175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844529.914202:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267865344:0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.914224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844529.914253:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267865088:0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.914278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844529.914300:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844529.914305:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267865216:0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.914328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844529.914371:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267864960 00000100:00100000:0.0:1788844529.914380:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267864960 00000100:00100000:0.0:1788844529.914436:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267865344 00000100:00100000:0.0:1788844529.914439:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267865344 00000100:00100000:0.0:1788844529.914464:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267865088 00000100:00100000:0.0:1788844529.914467:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267865088 00000100:00100000:0.0:1788844529.914802:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788844529.914819:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267864960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.914898:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267864960:12345-0@lo:400:kworker.0 Request processed in 85us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844529.914925:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788844529.914951:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788844529.914957:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267865344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.915768:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267865344:12345-0@lo:400:kworker.0 Request processed in 809us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844529.915775:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788844529.915796:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788844529.915806:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267865088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.916234:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267865088:12345-0@lo:400:kworker.0 Request processed in 430us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844529.916242:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788844529.916274:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267865472 00000100:00100000:0.0:1788844529.916284:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267865472 00000100:00100000:0.0:1788844529.916330:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267865216 00000100:00100000:0.0:1788844529.916333:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267865216 00000100:00100000:0.0:1788844529.916356:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788844529.916363:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267865472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.916404:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267865472:12345-0@lo:400:kworker.0 Request processed in 42us (2313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844529.916410:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788844529.916422:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788844529.916428:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267865216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.916455:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267865216:12345-0@lo:400:kworker.0 Request processed in 28us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844529.916461:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788844529.916924:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267864832 00000100:00100000:0.0:1788844529.916931:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267864832 00000100:00100000:0.0:1788844529.916986:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788844529.917006:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267864832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.917050:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267864832:12345-0@lo:400:kworker.0 Request processed in 56us (2874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844529.917056:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1788844529.917112:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844529.917117:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844529.917120:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844529.917168:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267864832:0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.917187:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267865344:0@lo:400:kworker.0 00000100:00100000:0.0:1788844529.917203:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267864960:0@lo:400:kworker.0 00010000:00080000:0.0:1788844529.917221:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec5992680 x1875739267865472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844529.917233:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267865472:0@lo:400:kworker.0 00000100:00100000:1.0:1788844529.925951:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267865088:0@lo:400:kworker.0 00010000:00080000:1.0:1788844529.926180:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec5993480 x1875739267865216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844529.926195:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267865216:0@lo:400:kworker.0 00000100:00100000:0.0:1788844530.429050:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788844530.429085:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267865600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844530.429188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844530.429275:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267865600 00000100:00100000:0.0:1788844530.429287:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267865600 00000100:00100000:0.0:1788844530.429344:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788844530.429355:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267865600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788844530.429401:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844530.429454:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267865600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844530.429476:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788844530.429526:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aef800 x1875739267865600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844530.429575:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267865600:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788844530.536960:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:3.0:1788844530.536972:0:7640:0:(genops.c:885:class_export_put()) final put ffff91eec5756800/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:3.0:1788844530.537022:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec5756800/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 for lustre-OST0001 00000020:00000080:3.0:1788844530.537097:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec5755800 for lustre-OST0001 00010000:00010000:2.0:1788844530.873818:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844530.937739:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844530.937770:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267865728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844530.937866:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844530.937983:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267865728 00000100:00100000:0.0:1788844530.937993:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267865728 00000100:00100000:0.0:1788844530.938059:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788844530.938069:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267865728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788844530.938121:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844530.938172:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5992680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267865728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844530.938180:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788844530.938230:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec5991500 x1875739267865728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844530.938252:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267865728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844531.146989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844531.147057:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844531.147098:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244765056 00000100:00100000:1.0:1788844531.147111:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244765056 00000100:00100000:1.0:1788844531.147191:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:1.0:1788844531.147204:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244765056:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844531.147305:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244765056:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 104us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844531.147314:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00080000:1.0:1788844531.147344:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844531.147569:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244764928 00000100:00100000:3.0:1788844531.147575:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244764928 00000100:00100000:3.0:1788844531.147615:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 199 00000100:00100000:3.0:1788844531.147622:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2357:x1875739244764928:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844531.147660:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2357:x1875739244764928:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 39us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844531.147666:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 199 00010000:00010000:1.0:1788844531.901377:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788844532.543181:0:9046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing yml_node 00010000:00010000:3.0:1788844532.924712:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844533.947758:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844534.973636:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844535.034202:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267866240:0@lo:400:kworker.0 00000100:00100000:1.0:1788844535.034305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844535.034394:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788844535.034401:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267866112:0@lo:400:kworker.0 00000100:00100000:1.0:1788844535.034430:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844535.034524:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267865984:0@lo:400:kworker.0 00000100:00100000:3.0:1788844535.034582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844535.034613:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267866496:0@lo:400:kworker.0 00000100:00100000:3.0:1788844535.034650:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844535.034677:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788844535.034683:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267865856:0@lo:400:kworker.0 00000100:00100000:3.0:1788844535.034727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844535.034749:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267866368:0@lo:400:kworker.0 00000100:00100000:3.0:1788844535.034771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844535.034921:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267866112 00000100:00100000:1.0:1788844535.034933:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267866112 00000100:00100000:1.0:1788844535.035014:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267865984 00000100:00100000:1.0:1788844535.035018:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267865984 00000100:00100000:1.0:1788844535.035032:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267866368 00000100:00100000:1.0:1788844535.035034:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267866368 00000100:00100000:1.0:1788844535.035053:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788844535.035063:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267866112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844535.035138:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267866112:12345-0@lo:400:kworker.0 Request processed in 75us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844535.035146:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788844535.035177:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788844535.035183:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267865984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844535.035216:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267865984:12345-0@lo:400:kworker.0 Request processed in 34us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844535.035222:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788844535.035234:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788844535.035241:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267866368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844535.035265:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267866368:12345-0@lo:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844535.035271:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788844535.035325:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267866112:0@lo:400:kworker.0 00000100:00080000:3.0:1788844535.035406:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844535.035431:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267866368:0@lo:400:kworker.0 00000100:00100000:3.0:1788844535.035441:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267865984:0@lo:400:kworker.0 00000100:00100000:0.0:1788844535.036409:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267866240 00000100:00100000:0.0:1788844535.036426:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267866240 00000100:00100000:0.0:1788844535.036510:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267866496 00000100:00100000:0.0:1788844535.036515:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267866496 00000100:00100000:0.0:1788844535.036580:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788844535.036591:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267866240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844535.036708:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267866240:12345-0@lo:400:kworker.0 Request processed in 118us (2401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844535.036716:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788844535.036733:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788844535.036739:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267866496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844535.036779:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267866496:12345-0@lo:400:kworker.0 Request processed in 40us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844535.036786:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788844535.036818:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267865856 00000100:00100000:0.0:1788844535.036823:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267865856 00000100:00100000:0.0:1788844535.036848:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788844535.036855:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267865856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844535.036890:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267865856:12345-0@lo:400:kworker.0 Request processed in 36us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844535.036908:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788844535.036966:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267865856:0@lo:400:kworker.0 00010000:00080000:0.0:1788844535.036983:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8f800 x1875739267866496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844535.036997:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267866496:0@lo:400:kworker.0 00010000:00080000:0.0:1788844535.037047:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d6a00 x1875739267866240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844535.037058:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267866240:0@lo:400:kworker.0 00000100:00080000:3.0:1788844535.037280:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788844535.037286:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788844535.545998:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788844535.546029:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267866624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844535.546128:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844535.546265:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267866624 00000100:00100000:0.0:1788844535.546274:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267866624 00000100:00100000:0.0:1788844535.546362:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788844535.546373:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267866624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788844535.546433:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844535.546650:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267866624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 278us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844535.546659:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788844535.547209:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec5991500 x1875739267866624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844535.547236:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267866624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788844535.994999:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844536.058980:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267866752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844536.059091:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844536.059295:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267866752 00000100:00100000:0.0:1788844536.059308:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267866752 00000100:00100000:0.0:1788844536.059377:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788844536.059388:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267866752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788844536.059614:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844536.059682:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267866752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 295us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844536.059690:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788844536.059781:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec5990700 x1875739267866752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844536.059804:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267866752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844536.266813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844536.266890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844536.267088:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244765184 00000100:00100000:0.0:1788844536.267102:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244765184 00000100:00100000:0.0:1788844536.267182:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 201 00000100:00100000:0.0:1788844536.267197:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2355:x1875739244765184:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844536.267314:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2355:x1875739244765184:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 120us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844536.267323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 201 00000100:00100000:2.0:1788844536.267332:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244765312 00000100:00100000:2.0:1788844536.267337:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244765312 00000100:00100000:2.0:1788844536.267389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:2.0:1788844536.267398:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244765312:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:0.0:1788844536.267399:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844536.267435:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244765312:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 39us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844536.267465:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 50 00010000:00010000:1.0:1788844537.020768:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788844537.794119:0:9238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.111 00010000:00010000:0.0:1788844538.042890:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844539.070421:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844540.089736:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844540.155642:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267867136:0@lo:400:kworker.0 00000100:00100000:2.0:1788844540.155718:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844540.155780:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844540.155787:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267867264:0@lo:400:kworker.0 00000100:00100000:2.0:1788844540.155825:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844540.155867:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267867136 00000100:00100000:2.0:1788844540.155876:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267867136 00000100:00100000:2.0:1788844540.155928:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788844540.155937:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267867136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844540.155986:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267867136:12345-0@lo:400:kworker.0 Request processed in 50us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844540.155993:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788844540.156036:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267867136:0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.156191:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267866880:0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.156239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844540.156273:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267867392:0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.156307:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844540.156326:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788844540.156332:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267867008:0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.156355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844540.156375:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267867520:0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.156395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844540.156420:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267867264 00000100:00100000:0.0:1788844540.156424:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267867264 00000100:00100000:0.0:1788844540.156452:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267867520 00000100:00100000:0.0:1788844540.156455:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267867520 00000100:00100000:0.0:1788844540.156474:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788844540.156480:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267867264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.156517:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267867264:12345-0@lo:400:kworker.0 Request processed in 36us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844540.156523:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788844540.156566:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788844540.156573:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267867520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.156616:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267867520:12345-0@lo:400:kworker.0 Request processed in 43us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844540.156623:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788844540.156638:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844540.156641:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844540.156644:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844540.156653:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267867392 00000100:00100000:0.0:1788844540.156656:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267867392 00000100:00100000:0.0:1788844540.156690:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267867008 00000100:00100000:0.0:1788844540.156694:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267867008 00000100:00100000:0.0:1788844540.156708:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788844540.156712:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267867392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.156741:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267867392:12345-0@lo:400:kworker.0 Request processed in 29us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844540.156746:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788844540.156756:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788844540.156762:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267867008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.156786:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267867008:12345-0@lo:400:kworker.0 Request processed in 24us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844540.156791:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788844540.156832:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844540.156854:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267867008:0@lo:400:kworker.0 00010000:00080000:0.0:1788844540.156867:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb390700 x1875739267867520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844540.156876:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267867520:0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.156886:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267867392:0@lo:400:kworker.0 00010000:00080000:0.0:1788844540.156913:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb393100 x1875739267867264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844540.156921:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267867264:0@lo:400:kworker.0 00000100:00100000:2.0:1788844540.157817:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267866880 00000100:00100000:2.0:1788844540.157826:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267866880 00000100:00100000:2.0:1788844540.157873:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788844540.157882:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267866880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844540.157945:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267866880:12345-0@lo:400:kworker.0 Request processed in 64us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844540.157952:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788844540.158039:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267866880:0@lo:400:kworker.0 00000100:00100000:0.0:1788844540.666886:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267867648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844540.667004:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844540.667113:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267867648 00000100:00100000:0.0:1788844540.667145:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267867648 00000100:00100000:0.0:1788844540.667991:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788844540.668006:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267867648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788844540.668065:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844540.668146:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267867648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (1143us total) trans 0 rc 0/0 00010000:00080000:3.0:1788844540.668757:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec5991500 x1875739267867648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844540.668782:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267867648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844540.672612:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788844541.125815:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844541.179300:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844541.179321:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267867776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844541.179643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844541.179719:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267867776 00000100:00100000:2.0:1788844541.179740:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267867776 00000100:00100000:2.0:1788844541.179803:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788844541.179813:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267867776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844541.179849:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844541.179894:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267867776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844541.179900:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788844541.179942:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb393b80 x1875739267867776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844541.179960:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267867776:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788844541.231506:0:9336:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.111 00000100:00100000:2.0:1788844541.387009:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844541.387161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844541.388453:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244765568 00000100:00100000:0.0:1788844541.388466:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244765568 00000100:00100000:0.0:1788844541.388554:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:0.0:1788844541.388565:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244765568:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844541.389210:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244765568:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 644us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844541.389220:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00080000:2.0:1788844541.390029:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844541.391256:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244765440 00000100:00100000:1.0:1788844541.391344:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244765440 00000100:00100000:1.0:1788844541.391406:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 203 00000100:00100000:1.0:1788844541.391417:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2355:x1875739244765440:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844541.391999:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2355:x1875739244765440:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 581us (4997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844541.392017:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 203 00010000:00010000:0.0:1788844542.138070:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844543.162290:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844544.186173:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788844544.329481:0:9433:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.111 00010000:00010000:1.0:1788844545.210293:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844545.277759:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267867904:0@lo:400:kworker.0 00000100:00100000:0.0:1788844545.277834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844545.277993:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267867904 00000100:00100000:2.0:1788844545.278002:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267867904 00000100:00100000:2.0:1788844545.278053:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788844545.278073:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267867904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844545.278654:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267868032:0@lo:400:kworker.0 00000100:00100000:3.0:1788844545.278755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844545.278809:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267868032 00000100:00100000:3.0:1788844545.278813:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267868032 00000100:00100000:3.0:1788844545.278863:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788844545.278871:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267868032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844545.278912:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267868032:12345-0@lo:400:kworker.0 Request processed in 42us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844545.278919:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788844545.278961:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267868032:0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.281760:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788844545.281781:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267868160:0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.281845:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844545.281889:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267868160 00000100:00100000:1.0:1788844545.281896:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267868160 00000100:00100000:1.0:1788844545.281952:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788844545.281960:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267868160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.282010:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267868160:12345-0@lo:400:kworker.0 Request processed in 50us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844545.282018:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788844545.282058:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267868160:0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.282120:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267868288:0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.282148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844545.282177:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267868288 00000100:00100000:1.0:1788844545.282181:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267868288 00000100:00100000:1.0:1788844545.282225:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788844545.282232:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267868288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.282266:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267868288:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844545.282273:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788844545.282300:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8c700 x1875739267868288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844545.282331:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267868288:0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.282364:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788844545.282372:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267868416:0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.282398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844545.282422:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267868416 00000100:00100000:1.0:1788844545.282426:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267868416 00000100:00100000:1.0:1788844545.282452:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788844545.282459:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267868416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.282492:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267868416:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844545.282498:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788844545.282525:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267868416:0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.282586:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267868544:0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.282609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844545.282636:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267868544 00000100:00100000:1.0:1788844545.282640:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267868544 00000100:00100000:1.0:1788844545.282666:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788844545.282672:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267868544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.282722:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267868544:12345-0@lo:400:kworker.0 Request processed in 49us (111us total) trans 0 rc 0/0 00000100:00080000:3.0:1788844545.284428:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788844545.284437:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788844545.284441:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788844545.284724:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8c700 x1875739267868544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844545.284739:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267868544:0@lo:400:kworker.0 00000100:00100000:1.0:1788844545.285253:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788844545.287321:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267867904:12345-0@lo:400:kworker.0 Request processed in 9252us (9478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844545.287335:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788844545.287419:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267867904:0@lo:400:kworker.0 00000100:00100000:3.0:1788844545.786021:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267868672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844545.786094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844545.786176:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267868672 00000100:00100000:2.0:1788844545.786184:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267868672 00000100:00100000:2.0:1788844545.786238:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788844545.786247:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267868672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788844545.786284:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844545.786344:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267868672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844545.786351:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788844545.790088:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb393800 x1875739267868672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844545.790115:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267868672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788844546.238219:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844546.305467:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267868800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844546.305584:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844546.305666:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267868800 00000100:00100000:0.0:1788844546.305675:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267868800 00000100:00100000:0.0:1788844546.305743:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788844546.305753:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267868800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788844546.305800:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844546.305846:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267868800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844546.305854:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788844546.305893:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aef800 x1875739267868800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844546.305912:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267868800:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788844546.397776:0:9481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 01:15:44 EDT 2026 00000100:00100000:3.0:1788844546.496979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844546.497029:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844546.497082:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244765696 00000100:00100000:0.0:1788844546.497093:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244765696 00000100:00100000:0.0:1788844546.497148:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 205 00000100:00100000:0.0:1788844546.497157:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2355:x1875739244765696:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844546.497240:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2355:x1875739244765696:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 84us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844546.497249:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 205 00000100:00100000:1.0:1788844546.497808:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244765824 00000100:00100000:1.0:1788844546.497815:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244765824 00000100:00100000:1.0:1788844546.497881:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:1.0:1788844546.497888:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244765824:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844546.497934:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244765824:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 47us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844546.497942:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00080000:3.0:1788844546.498238:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788844547.258671:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844548.284934:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844549.307359:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844550.330610:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844550.396109:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267868928:0@lo:400:kworker.0 00000100:00100000:1.0:1788844550.396240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844550.397124:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267868928 00000100:00100000:3.0:1788844550.397139:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267868928 00000100:00100000:3.0:1788844550.397222:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788844550.397233:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267868928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.397443:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267869056:0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.397489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844550.397642:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267869184:0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.397687:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844550.397713:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844550.397719:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267869312:0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.397747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844550.397780:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267869568:0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.397804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844550.397822:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788844550.397827:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267869440:0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.397849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844550.397890:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267869056 00000100:00100000:2.0:1788844550.397895:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267869056 00000100:00100000:2.0:1788844550.397930:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267869184 00000100:00100000:2.0:1788844550.397933:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267869184 00000100:00100000:2.0:1788844550.397957:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267869440 00000100:00100000:2.0:1788844550.397960:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267869440 00000100:00100000:2.0:1788844550.397976:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788844550.397983:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267869056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.398036:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267869056:12345-0@lo:400:kworker.0 Request processed in 52us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844550.400462:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267868928:12345-0@lo:400:kworker.0 Request processed in 3214us (4206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844550.400501:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788844550.401129:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267868928:0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.401394:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788844550.402951:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844550.404857:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788844550.404898:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267869184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.405174:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788844550.405188:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267869440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.405241:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267869440:12345-0@lo:400:kworker.0 Request processed in 57us (7390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844550.405250:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788844550.405347:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267869440:0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.405368:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267869056:0@lo:400:kworker.0 00000100:00100000:0.0:1788844550.405493:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267869184:12345-0@lo:400:kworker.0 Request processed in 619us (7804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844550.405501:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788844550.405993:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267869184:0@lo:400:kworker.0 00000100:00100000:3.0:1788844550.406389:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267869312 00000100:00100000:3.0:1788844550.406400:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267869312 00000100:00100000:3.0:1788844550.406499:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267869568 00000100:00100000:3.0:1788844550.406503:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267869568 00000100:00100000:2.0:1788844550.406558:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788844550.406570:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267869312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.406672:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267869312:12345-0@lo:400:kworker.0 Request processed in 105us (8923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844550.406688:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788844550.406709:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb391f80 x1875739267869312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844550.406724:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267869312:0@lo:400:kworker.0 00000100:00080000:1.0:1788844550.406851:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788844550.406856:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844550.407112:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788844550.407121:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267869568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844550.407176:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267869568:12345-0@lo:400:kworker.0 Request processed in 57us (9371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844550.407182:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788844550.407220:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb391880 x1875739267869568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844550.407231:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267869568:0@lo:400:kworker.0 00000100:00100000:2.0:1788844550.908125:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267869696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844550.908230:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844550.908342:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267869696 00000100:00100000:2.0:1788844550.908354:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267869696 00000100:00100000:2.0:1788844550.908429:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788844550.908440:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267869696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788844550.908506:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844550.908619:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267869696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844550.908632:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788844550.910298:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eef3173b80 x1875739267869696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844550.911583:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267869696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788844551.354511:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844551.419242:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267869824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844551.419336:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844551.419464:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267869824 00000100:00100000:3.0:1788844551.419473:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267869824 00000100:00100000:3.0:1788844551.419534:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788844551.419562:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267869824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844551.419608:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844551.422563:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267869824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2991us (3215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844551.422587:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788844551.424210:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed829b480 x1875739267869824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844551.424239:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267869824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844551.618408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844551.618502:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844551.618630:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244766080 00000100:00100000:2.0:1788844551.618640:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244766080 00000100:00100000:2.0:1788844551.618722:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:2.0:1788844551.618733:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244766080:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844551.618809:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244766080:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844551.618818:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00080000:1.0:1788844551.620060:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844551.625188:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244765952 00000100:00100000:3.0:1788844551.625206:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244765952 00000100:00100000:3.0:1788844551.625380:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 207 00000100:00100000:3.0:1788844551.625391:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2355:x1875739244765952:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844551.625568:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2355:x1875739244765952:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 178us (7170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844551.625597:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 207 00010000:00010000:2.0:1788844552.378835:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844553.405074:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844554.426721:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844555.450911:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844555.518594:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267869952:0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.518673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844555.518736:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267870464:0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.518767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844555.518796:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788844555.518798:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267870464 00000100:00100000:0.0:1788844555.518804:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267870080:0@lo:400:kworker.0 00000100:00100000:3.0:1788844555.518809:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267870464 00000100:00100000:0.0:1788844555.518830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844555.518854:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267870592:0@lo:400:kworker.0 00000100:00100000:3.0:1788844555.518867:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267870080 00000100:00100000:3.0:1788844555.518872:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267870080 00000100:00100000:0.0:1788844555.518881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844555.518902:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788844555.518913:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267870464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.518932:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267870208:0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.518970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844555.518981:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267870464:12345-0@lo:400:kworker.0 Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844555.518990:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788844555.518995:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844555.519004:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267870336:0@lo:400:kworker.0 00000100:00100000:3.0:1788844555.519009:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267870208 00000100:00100000:3.0:1788844555.519014:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267870208 00000100:00100000:0.0:1788844555.519031:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844555.519037:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788844555.519044:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267870080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.519069:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267869952 00000100:00100000:0.0:1788844555.519075:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267869952 00000100:00100000:3.0:1788844555.519080:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267870080:12345-0@lo:400:kworker.0 Request processed in 35us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844555.519087:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788844555.519104:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788844555.519113:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788844555.519114:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267870208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.519126:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267869952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844555.519155:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267870208:12345-0@lo:400:kworker.0 Request processed in 44us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844555.519162:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788844555.519170:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267869952:12345-0@lo:400:kworker.0 Request processed in 47us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844555.519179:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1788844555.519181:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844555.519217:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267870592 00000100:00100000:0.0:1788844555.519222:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267870592 00000100:00100000:3.0:1788844555.519243:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267870208:0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.519255:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267870336 00000100:00100000:0.0:1788844555.519259:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267870336 00000100:00100000:3.0:1788844555.519283:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267870080:0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.519288:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788844555.519297:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267870592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844555.519317:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267869952:0@lo:400:kworker.0 00000100:00100000:3.0:1788844555.519331:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267870464:0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.519340:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267870592:12345-0@lo:400:kworker.0 Request processed in 43us (456us total) trans 0 rc 0/0 00010000:00080000:3.0:1788844555.519356:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed829aa00 x1875739267870592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844555.519357:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788844555.519372:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267870592:0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.519375:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788844555.519386:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267870336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844555.519428:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267870336:12345-0@lo:400:kworker.0 Request processed in 44us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844555.519434:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788844555.519455:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844555.519457:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788844555.519492:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8299180 x1875739267870336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844555.519512:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267870336:0@lo:400:kworker.0 00000100:00100000:2.0:1788844556.026042:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267870720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844556.026140:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844556.026403:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267870720 00000100:00100000:1.0:1788844556.026415:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267870720 00000100:00100000:1.0:1788844556.026483:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788844556.026505:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267870720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844556.026574:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844556.026636:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267870720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844556.026666:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788844556.026717:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eef3171f80 x1875739267870720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844556.026739:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267870720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788844556.476752:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844556.537945:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267870848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844556.538052:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844556.538224:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267870848 00000100:00100000:0.0:1788844556.538235:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267870848 00000100:00100000:0.0:1788844556.538305:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788844556.538316:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267870848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788844556.538362:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844556.538424:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267870848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844556.538432:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788844556.538860:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eef3171180 x1875739267870848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844556.538886:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267870848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844556.742144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844556.742206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844556.742274:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244766208 00000100:00100000:2.0:1788844556.742288:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244766208 00000100:00100000:2.0:1788844556.742356:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 209 00000100:00100000:2.0:1788844556.742368:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2356:x1875739244766208:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844556.742463:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2356:x1875739244766208:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844556.742471:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 209 00000100:00100000:3.0:1788844556.743745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244766336 00000100:00100000:3.0:1788844556.743764:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244766336 00000100:00100000:3.0:1788844556.743973:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:3.0:1788844556.743988:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2356:x1875739244766336:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844556.744083:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2356:x1875739244766336:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 99us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844556.744091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00080000:2.0:1788844556.744252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788844557.497815:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844558.528718:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844559.558120:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844560.575969:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844560.634136:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267870976:0@lo:400:kworker.0 00000100:00100000:3.0:1788844560.634241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844560.642962:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267870976 00000100:00100000:0.0:1788844560.642977:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267870976 00000100:00100000:0.0:1788844560.643051:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788844560.643063:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267870976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.643198:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267870976:12345-0@lo:400:kworker.0 Request processed in 137us (8957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844560.643206:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788844560.643280:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267871104:0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.643325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844560.643357:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267871616:0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.643388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844560.643424:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788844560.643431:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267871488:0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.643457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844560.643487:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267871232:0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.643711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844560.643734:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844560.643740:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267871360:0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.643778:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844560.643831:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267871104 00000100:00100000:0.0:1788844560.643838:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267871104 00000100:00100000:0.0:1788844560.643876:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267871488 00000100:00100000:0.0:1788844560.643878:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267871488 00000100:00100000:0.0:1788844560.643922:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267871232 00000100:00100000:0.0:1788844560.643925:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267871232 00000100:00100000:0.0:1788844560.643943:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788844560.643952:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267871104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.644000:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267871104:12345-0@lo:400:kworker.0 Request processed in 49us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844560.644008:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788844560.644026:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788844560.644034:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267871488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.644062:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267871488:12345-0@lo:400:kworker.0 Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844560.644085:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788844560.644101:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788844560.644108:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267871232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.644146:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267871232:12345-0@lo:400:kworker.0 Request processed in 39us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844560.644153:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788844560.644175:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267871616 00000100:00100000:0.0:1788844560.644179:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267871616 00000100:00100000:0.0:1788844560.644208:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267871360 00000100:00100000:0.0:1788844560.644210:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267871360 00000100:00100000:0.0:1788844560.644234:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788844560.644241:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267871616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.644278:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267871616:12345-0@lo:400:kworker.0 Request processed in 37us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844560.644284:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788844560.644295:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788844560.644302:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267871360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.644330:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267871360:12345-0@lo:400:kworker.0 Request processed in 29us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844560.644335:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788844560.644368:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844560.644373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844560.644375:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788844560.644429:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed829b100 x1875739267871360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844560.644448:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267871360:0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.644472:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267871232:0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.644525:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267871488:0@lo:400:kworker.0 00000100:00100000:0.0:1788844560.644564:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267871104:0@lo:400:kworker.0 00010000:00080000:0.0:1788844560.644577:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed829aa00 x1875739267871616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844560.644586:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267871616:0@lo:400:kworker.0 00000100:00100000:3.0:1788844560.645029:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267870976:0@lo:400:kworker.0 00000100:00100000:3.0:1788844561.145896:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844561.145928:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267871744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844561.146034:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844561.146142:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267871744 00000100:00100000:3.0:1788844561.146152:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267871744 00000100:00100000:3.0:1788844561.146212:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788844561.146222:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267871744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844561.146265:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844561.146330:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267871744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844561.146337:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788844561.146396:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8ea00 x1875739267871744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844561.146418:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267871744:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788844561.595228:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844561.669065:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844561.669277:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267871872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844561.669402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844561.669500:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267871872 00000100:00100000:2.0:1788844561.669511:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267871872 00000100:00100000:2.0:1788844561.669603:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788844561.669615:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267871872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844561.669664:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844561.669722:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267871872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844561.669730:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788844561.669787:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eef3170e00 x1875739267871872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844561.669809:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267871872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844561.857765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844561.857829:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844561.857909:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244766592 00000100:00100000:0.0:1788844561.857924:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244766592 00000100:00100000:0.0:1788844561.858025:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:0.0:1788844561.858040:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244766592:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844561.858151:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244766592:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 115us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844561.858160:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:2.0:1788844561.858493:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244766464 00000100:00100000:2.0:1788844561.858499:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244766464 00000100:00100000:2.0:1788844561.858564:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 211 00000100:00100000:2.0:1788844561.858573:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244766464:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844561.858619:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244766464:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 47us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844561.858626:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 211 00000100:00080000:1.0:1788844561.858894:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788844562.618326:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844563.642078:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844564.665881:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788844564.714642:0:10112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:16:02 (1788844562) === 00000100:00100000:1.0:1788844565.285416:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844565.285646:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244766720 00000100:00100000:0.0:1788844565.285661:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244766720 00000100:00100000:0.0:1788844565.285739:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 212 00000100:00100000:0.0:1788844565.285751:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:8131:x1875739244766720:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788844565.285775:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844565.285801:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5526600/0x7f1093851e2d9314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f86f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844565.285844:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526600/0x7f1093851e2d9314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f86f expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844565.285883:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5526600/0x7f1093851e2d9314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f86f expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844565.285895:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526600, rc 0) 00000100:00100000:0.0:1788844565.285987:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:8131:x1875739244766720:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 237us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.285996:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 212 00000100:00100000:2.0:1788844565.300985:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844565.301106:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244766848 00000100:00100000:0.0:1788844565.301120:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244766848 00000100:00100000:0.0:1788844565.301199:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 213 00000100:00100000:0.0:1788844565.301212:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:8131:x1875739244766848:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788844565.302592:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:8131:x1875739244766848:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 1372us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.302607:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 213 00000100:00100000:3.0:1788844565.305903:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844565.306123:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244766976 00000100:00100000:2.0:1788844565.306139:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244766976 00000100:00100000:2.0:1788844565.306235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 214 00000100:00100000:2.0:1788844565.306258:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:8131:x1875739244766976:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788844565.306657:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:8131:x1875739244766976:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 399us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844565.306667:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 214 00000100:00100000:1.0:1788844565.315282:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844565.315403:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244767104 00000100:00100000:0.0:1788844565.315420:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244767104 00000100:00100000:0.0:1788844565.315503:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 215 00000100:00100000:0.0:1788844565.315515:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:8135:x1875739244767104:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788844565.315865:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:8135:x1875739244767104:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 352us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.315873:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 215 00000100:00100000:3.0:1788844565.375594:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844565.376066:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244767232 00000100:00100000:2.0:1788844565.376081:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244767232 00000100:00100000:2.0:1788844565.376206:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 216 00000100:00100000:2.0:1788844565.376218:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:8135:x1875739244767232:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788844565.376629:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:8135:x1875739244767232:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 412us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844565.376638:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 216 00000100:00100000:3.0:1788844565.399211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844565.402227:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244767360 00000100:00100000:0.0:1788844565.402243:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244767360 00000100:00100000:0.0:1788844565.402328:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 217 00000100:00100000:0.0:1788844565.402338:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:8131:x1875739244767360:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788844565.402368:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844565.402394:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5526200/0x7f1093851e2d931b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f899 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844565.402426:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526200/0x7f1093851e2d931b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f899 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844565.402437:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5526200/0x7f1093851e2d931b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f899 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844565.402445:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526200, rc 0) 00000100:00100000:0.0:1788844565.402517:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:8131:x1875739244767360:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 181us (3316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.402524:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 217 00000100:00100000:1.0:1788844565.412687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844565.412810:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244767488 00000100:00100000:2.0:1788844565.412827:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244767488 00000100:00100000:2.0:1788844565.412906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 218 00000100:00100000:2.0:1788844565.412917:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:8131:x1875739244767488:12345-192.168.204.43@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788844565.412943:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788844565.412967:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788844565.412972:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788844565.412976:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788844565.412979:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788844565.416992:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:8131:x1875739244767488:12345-192.168.204.43@tcp:256:mount.lustre.0 Request processed in 4046us (4290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.417012:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 218 00000100:00100000:3.0:1788844565.424690:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844565.424773:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244767616 00000100:00100000:2.0:1788844565.424785:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244767616 00000100:00100000:2.0:1788844565.424859:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 219 00000100:00100000:2.0:1788844565.424868:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:8131:x1875739244767616:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788844565.424884:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844565.424918:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ef0205c200/0x7f1093851e2d9322 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f8a0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844565.424948:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0205c200/0x7f1093851e2d9322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8a0 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844565.424960:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ef0205c200/0x7f1093851e2d9322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8a0 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844565.424970:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0205c200, rc 0) 00000100:00100000:2.0:1788844565.425029:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:8131:x1875739244767616:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 161us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844565.425036:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 219 00000100:00100000:1.0:1788844565.430665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844565.430783:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244767744 00000100:00100000:0.0:1788844565.430794:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244767744 00000100:00100000:0.0:1788844565.430861:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 220 00000100:00100000:0.0:1788844565.430871:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:8131:x1875739244767744:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788844565.431162:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:8131:x1875739244767744:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 291us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.431171:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 220 00000100:00100000:3.0:1788844565.433747:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844565.433972:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244767872 00000100:00100000:0.0:1788844565.433981:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244767872 00000100:00100000:0.0:1788844565.436144:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 221 00000100:00100000:0.0:1788844565.436182:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:8131:x1875739244767872:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788844565.436419:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:8131:x1875739244767872:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 244us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.436428:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 221 00000100:00100000:3.0:1788844565.454934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844565.455268:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244768000 00000100:00100000:2.0:1788844565.455278:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244768000 00000100:00100000:2.0:1788844565.455345:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 222 00000100:00100000:2.0:1788844565.455354:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:8137:x1875739244768000:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788844565.455647:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:8137:x1875739244768000:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 293us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844565.455657:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 222 00000100:00100000:1.0:1788844565.459062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844565.459185:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244768128 00000100:00100000:0.0:1788844565.459199:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244768128 00000100:00100000:0.0:1788844565.459277:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 223 00000100:00100000:0.0:1788844565.459289:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:8137:x1875739244768128:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788844565.459682:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:8137:x1875739244768128:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 392us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.459692:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 223 00000100:00100000:3.0:1788844565.466512:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844565.467274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844565.467406:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244768384 00000100:00100000:0.0:1788844565.467420:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244768384 00000100:00100000:0.0:1788844565.467513:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244768256 00000100:00100000:0.0:1788844565.467517:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244768256 00000100:00100000:0.0:1788844565.467586:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:0.0:1788844565.467600:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244768384:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844565.467720:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244768384:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 122us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.467730:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:0.0:1788844565.467751:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:0.0:1788844565.467756:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1875739244768256:12345-192.168.204.43@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788844565.467785:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 89582201-bdf6-4401-b202-b9313c368ae5@192.168.204.43@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:0.0:1788844565.467857:0:5838:0:(genops.c:1385:class_connect()) connect: client 89582201-bdf6-4401-b202-b9313c368ae5, cookie 0x7f1093851e2d9329 00000100:00080000:2.0:1788844565.468004:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00100000:0.0:1788844565.468234:0:5838:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788844565.470114:0:5838:0:(import.c:65:import_set_state_nolock()) ffff91eec71b7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844565.470234:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+6:2353:x1875739244768256:12345-192.168.204.43@tcp:38:mount.lustre.0 Request processed in 2471us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.470247:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:3.0:1788844565.477029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844565.477087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844565.479035:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244768512 00000100:00100000:0.0:1788844565.479058:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244768512 00000100:00100000:1.0:1788844565.479197:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244768640 00000100:00100000:1.0:1788844565.479203:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244768640 00000100:00100000:1.0:1788844565.479275:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:1.0:1788844565.479286:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+7:8131:x1875739244768640:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788844565.479389:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788844565.479509:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+7:8131:x1875739244768640:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 223us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844565.479517:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1788844565.481787:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:0.0:1788844565.481816:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+6:0:x1875739244768512:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788844565.481860:0:8217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788844565.481974:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+6:0:x1875739244768512:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 162us (4960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.481982:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00080000:3.0:1788844565.482217:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844565.485896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844565.486283:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244768768 00000100:00100000:1.0:1788844565.486297:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244768768 00000100:00100000:1.0:1788844565.486388:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1788844565.486400:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+6:8131:x1875739244768768:12345-192.168.204.43@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788844565.486522:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+6:8131:x1875739244768768:12345-192.168.204.43@tcp:40:mount.lustre.0 Request processed in 123us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844565.486530:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:2.0:1788844565.490665:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844565.490812:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244768896 00000100:00100000:0.0:1788844565.490829:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244768896 00000100:00100000:0.0:1788844565.490914:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:0.0:1788844565.490924:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875739244768896:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788844565.490970:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 89582201-bdf6-4401-b202-b9313c368ae5@192.168.204.43@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:0.0:1788844565.491016:0:6687:0:(genops.c:1385:class_connect()) connect: client 89582201-bdf6-4401-b202-b9313c368ae5, cookie 0x7f1093851e2d9330 00002000:00100000:0.0:1788844565.491034:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 89582201-bdf6-4401-b202-b9313c368ae5/ffff91eec71b7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788844565.491069:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788844565.491397:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788844565.491440:0:6687:0:(import.c:65:import_set_state_nolock()) ffff91eec71b4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844565.491533:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+6:2353:x1875739244768896:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 608us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.491585:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:2.0:1788844565.493358:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844565.493441:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844565.493588:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244769024 00000100:00100000:3.0:1788844565.493601:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244769024 00000100:00100000:3.0:1788844565.493646:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:3.0:1788844565.493664:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875739244769024:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788844565.493703:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 89582201-bdf6-4401-b202-b9313c368ae5@192.168.204.43@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:3.0:1788844565.493740:0:6686:0:(genops.c:1385:class_connect()) connect: client 89582201-bdf6-4401-b202-b9313c368ae5, cookie 0x7f1093851e2d9337 00002000:00100000:3.0:1788844565.493755:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 89582201-bdf6-4401-b202-b9313c368ae5/ffff91eeff244000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788844565.493786:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788844565.493836:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244769152 00000100:00100000:0.0:1788844565.493841:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244769152 00000100:00100000:0.0:1788844565.493887:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:0.0:1788844565.493894:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89582201-bdf6-4401-b202-b9313c368ae5+6:8131:x1875739244769152:12345-192.168.204.43@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788844565.493993:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788844565.494090:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:89582201-bdf6-4401-b202-b9313c368ae5+6:8131:x1875739244769152:12345-192.168.204.43@tcp:33:mount.lustre.0 Request processed in 195us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.494098:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00002000:00080000:3.0:1788844565.494137:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788844565.494171:0:6686:0:(import.c:65:import_set_state_nolock()) ffff91eeff240000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788844565.494206:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:89582201-bdf6-4401-b202-b9313c368ae5+6:2353:x1875739244769024:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 543us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844565.494214:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00010000:00010000:1.0:1788844565.689883:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844565.757797:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267872000:0@lo:400:kworker.0 00000100:00100000:0.0:1788844565.757828:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267872256:0@lo:400:kworker.0 00000100:00100000:2.0:1788844565.757912:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267872128:0@lo:400:kworker.0 00000100:00100000:3.0:1788844565.757987:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267872384:0@lo:400:kworker.0 00000100:00100000:1.0:1788844565.758832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844565.758928:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267872512:0@lo:400:kworker.0 00000100:00100000:1.0:1788844565.758969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844565.759036:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267872000 00000100:00100000:1.0:1788844565.759047:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267872000 00000100:00100000:1.0:1788844565.759117:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788844565.759128:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267872000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844565.759193:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267872000:12345-0@lo:400:kworker.0 Request processed in 67us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844565.759201:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788844565.759256:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267872000:0@lo:400:kworker.0 00000100:00100000:1.0:1788844565.759290:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267872512 00000100:00100000:1.0:1788844565.759323:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267872512 00000100:00100000:1.0:1788844565.759371:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788844565.759378:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267872512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844565.759418:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267872512:12345-0@lo:400:kworker.0 Request processed in 41us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844565.759425:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788844565.759453:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267872512:0@lo:400:kworker.0 00000100:00080000:1.0:1788844565.759871:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844565.764020:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844565.764118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267872256 00000100:00100000:0.0:1788844565.764131:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267872256 00000100:00100000:0.0:1788844565.764218:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788844565.764232:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267872256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844565.764327:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267872256:12345-0@lo:400:kworker.0 Request processed in 97us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.764336:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788844565.764364:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844565.764406:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267872256:0@lo:400:kworker.0 00000100:00100000:2.0:1788844565.767349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844565.767421:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267872640:0@lo:400:kworker.0 00000100:00100000:2.0:1788844565.767495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844565.767531:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267872640 00000100:00100000:2.0:1788844565.767559:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267872640 00000100:00100000:2.0:1788844565.767634:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788844565.767644:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267872640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844565.767721:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267872640:12345-0@lo:400:kworker.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844565.767728:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788844565.767756:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788844565.767795:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8299500 x1875739267872640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844565.767814:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267872640:0@lo:400:kworker.0 00000100:00100000:0.0:1788844565.769920:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267872128 00000100:00100000:0.0:1788844565.769937:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267872128 00000100:00100000:0.0:1788844565.770008:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788844565.770020:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267872128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844565.770140:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267872128:12345-0@lo:400:kworker.0 Request processed in 122us (2798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.770150:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788844565.770176:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267872128:0@lo:400:kworker.0 00000100:00100000:3.0:1788844565.774184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844565.774333:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267872384 00000100:00100000:0.0:1788844565.774348:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267872384 00000100:00100000:0.0:1788844565.774434:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788844565.774447:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267872384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844565.774560:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267872384:12345-0@lo:400:kworker.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844565.774568:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788844565.774753:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788844565.774831:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed829bb80 x1875739267872384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844565.774852:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267872384:0@lo:400:kworker.0 00000001:00100000:1.0:1788844565.814260:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 89582201-bdf6-4401-b202-b9313c368ae5 00000100:00100000:2.0:1788844566.266676:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788844566.266718:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267872768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844566.269194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844566.269366:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267872768 00000100:00100000:3.0:1788844566.269379:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267872768 00000100:00100000:3.0:1788844566.269449:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788844566.269461:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267872768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844566.269497:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844566.269586:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267872768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844566.269594:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788844566.269797:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb39b100 x1875739267872768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844566.269820:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267872768:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788844566.377000:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 89582201-bdf6-4401-b202-b9313c368ae5 00010000:00010000:2.0:1788844566.715617:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844566.779001:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844566.779034:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267872896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844566.779143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844566.779560:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267872896 00000100:00100000:3.0:1788844566.779587:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267872896 00000100:00100000:3.0:1788844566.779654:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788844566.779665:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267872896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844566.779712:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844566.779797:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267872896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844566.779806:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788844566.780024:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8299180 x1875739267872896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844566.780051:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267872896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788844567.738353:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844568.764172:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788844569.425110:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 89582201-bdf6-4401-b202-b9313c368ae5 00010000:00010000:1.0:1788844569.788075:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844570.575413:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844570.575451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844570.575473:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844570.575503:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844570.575524:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844570.575653:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244769408 00000100:00100000:0.0:1788844570.575662:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244769408 00000100:00100000:0.0:1788844570.575727:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244769536 00000100:00100000:0.0:1788844570.575730:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244769536 00000100:00100000:0.0:1788844570.575751:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:0.0:1788844570.575759:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244769408:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844570.575830:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244769408:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 72us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844570.575838:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:0.0:1788844570.575854:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:0.0:1788844570.575859:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244769536:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844570.575880:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244769536:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 21us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844570.575886:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:2.0:1788844570.576049:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244769280 00000100:00100000:2.0:1788844570.576054:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244769280 00000100:00100000:2.0:1788844570.576085:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 225 00000100:00100000:2.0:1788844570.576092:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244769280:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844570.576129:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244769280:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 38us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844570.576135:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 225 00000100:00100000:2.0:1788844570.576165:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244769664 00000100:00100000:2.0:1788844570.576168:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244769664 00000100:00100000:2.0:1788844570.576194:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244769792 00000100:00100000:2.0:1788844570.576197:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244769792 00000100:00100000:2.0:1788844570.576228:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:2.0:1788844570.576234:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244769664:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844570.576257:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244769664:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 23us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844570.576263:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:2.0:1788844570.576272:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:2.0:1788844570.576277:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244769792:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844570.576295:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244769792:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 18us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844570.576301:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00080000:3.0:1788844570.576658:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788844570.576662:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788844570.576664:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788844570.810010:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844570.874751:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267873024:0@lo:400:kworker.0 00000100:00100000:2.0:1788844570.874837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844570.874909:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267873536:0@lo:400:kworker.0 00000100:00100000:2.0:1788844570.874938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844570.874965:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788844570.874970:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267873152:0@lo:400:kworker.0 00000100:00100000:2.0:1788844570.874991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844570.875023:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267873664:0@lo:400:kworker.0 00000100:00100000:2.0:1788844570.875050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844570.875081:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267873664 00000100:00100000:2.0:1788844570.875088:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267873664 00000100:00100000:2.0:1788844570.875158:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788844570.875169:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefcef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267873664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844570.875243:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefcef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267873664:12345-0@lo:400:kworker.0 Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844570.875252:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788844570.875265:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267873280:0@lo:400:kworker.0 00000100:00100000:3.0:1788844570.875357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844570.875407:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788844570.875419:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267873408:0@lo:400:kworker.0 00000100:00100000:3.0:1788844570.875456:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844570.875498:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267873408 00000100:00100000:2.0:1788844570.875504:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267873408 00000100:00080000:3.0:1788844570.875510:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788844570.875517:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844570.875581:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788844570.875591:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267873408:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788844570.875629:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8e300 x1875739267873664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844570.875647:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267873408:12345-0@lo:400:kworker.0 Request processed in 56us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844570.875652:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267873664:0@lo:400:kworker.0 00000100:00100000:2.0:1788844570.875665:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788844570.875720:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8f100 x1875739267873408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844570.875734:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267873408:0@lo:400:kworker.0 00000100:00100000:1.0:1788844570.876141:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267873024 00000100:00100000:1.0:1788844570.876147:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267873024 00000100:00100000:1.0:1788844570.876183:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788844570.876190:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267873024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844570.876239:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267873024:12345-0@lo:400:kworker.0 Request processed in 50us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844570.876246:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788844570.876307:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267873536 00000100:00100000:1.0:1788844570.876312:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267873536 00000100:00100000:1.0:1788844570.876350:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267873152 00000100:00100000:1.0:1788844570.876354:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267873152 00000100:00100000:1.0:1788844570.876366:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267873280 00000100:00100000:1.0:1788844570.876379:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267873280 00000100:00100000:1.0:1788844570.876409:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788844570.876417:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267873536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844570.876453:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267873536:12345-0@lo:400:kworker.0 Request processed in 37us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844570.876459:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788844570.876470:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788844570.876476:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267873152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844570.876505:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267873152:12345-0@lo:400:kworker.0 Request processed in 31us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844570.876512:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788844570.876522:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788844570.876529:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267873280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844570.876586:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267873280:12345-0@lo:400:kworker.0 Request processed in 59us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844570.876592:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788844570.876624:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844570.876980:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267873280:0@lo:400:kworker.0 00000100:00100000:2.0:1788844570.877023:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267873152:0@lo:400:kworker.0 00000100:00100000:2.0:1788844570.877034:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267873024:0@lo:400:kworker.0 00000100:00100000:2.0:1788844570.877044:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267873536:0@lo:400:kworker.0 00000100:00100000:1.0:1788844571.386407:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267873792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844571.386479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844571.386577:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267873792 00000100:00100000:1.0:1788844571.386584:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267873792 00000100:00100000:1.0:1788844571.386632:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788844571.386640:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267873792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844571.386679:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844571.386722:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267873792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844571.386746:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788844571.386789:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb398000 x1875739267873792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844571.386808:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267873792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788844571.833732:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844571.900148:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267873920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844571.900254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844571.900399:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267873920 00000100:00100000:1.0:1788844571.900408:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267873920 00000100:00100000:1.0:1788844571.900464:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788844571.900475:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267873920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788844571.900515:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844571.900586:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267873920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844571.900593:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788844571.900634:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8285180 x1875739267873920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844571.900653:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267873920:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788844572.128483:0:10309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788844572.859844:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844573.887078:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844574.905929:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844575.688613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844575.688716:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244769920 00000100:00100000:1.0:1788844575.688728:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244769920 00000100:00100000:1.0:1788844575.688781:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 227 00000100:00100000:1.0:1788844575.688792:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244769920:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844575.689155:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244769920:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 363us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844575.689164:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 227 00000100:00100000:2.0:1788844575.696629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844575.696674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844575.696700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844575.696781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844575.696812:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244770432 00000100:00100000:3.0:1788844575.696813:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244770304 00000100:00100000:3.0:1788844575.696822:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244770304 00000100:00100000:2.0:1788844575.696833:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244770432 00000100:00100000:1.0:1788844575.696878:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244770176 00000100:00100000:1.0:1788844575.696883:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244770176 00000100:00100000:2.0:1788844575.696903:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:1.0:1788844575.696910:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244770048 00000100:00100000:1.0:1788844575.696912:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244770048 00000100:00100000:2.0:1788844575.696914:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244770432:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844575.696931:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:1.0:1788844575.696937:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244770176:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844575.696987:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244770432:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 75us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844575.697005:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:2.0:1788844575.697037:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00100000:2.0:1788844575.697044:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244770048:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844575.697590:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244770176:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 648us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844575.697657:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:3.0:1788844575.698735:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:3.0:1788844575.698754:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244770304:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844575.698815:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244770304:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 71us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844575.699010:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00080000:3.0:1788844575.699036:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788844575.699042:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788844575.699044:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844575.699493:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244770048:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 2446us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844575.699504:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 81 00010000:00010000:3.0:1788844575.930729:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844576.000618:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267874176:0@lo:400:kworker.0 00000100:00100000:0.0:1788844576.000726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844576.000787:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267874688:0@lo:400:kworker.0 00000100:00100000:1.0:1788844576.001420:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267874304:0@lo:400:kworker.0 00000100:00100000:0.0:1788844576.001726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844576.001805:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267874048:0@lo:400:kworker.0 00000100:00100000:1.0:1788844576.002417:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844576.002565:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788844576.002575:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267874432:0@lo:400:kworker.0 00000100:00100000:2.0:1788844576.005256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844576.005331:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267874560:0@lo:400:kworker.0 00000100:00100000:2.0:1788844576.005371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844576.010663:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267874688 00000100:00100000:2.0:1788844576.010686:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267874688 00000100:00100000:2.0:1788844576.010799:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788844576.010811:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267874688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844576.011059:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267874688:12345-0@lo:400:kworker.0 Request processed in 251us (9332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844576.011069:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788844576.011119:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267874048 00000100:00100000:2.0:1788844576.011124:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267874048 00000100:00100000:2.0:1788844576.011167:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788844576.011176:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267874048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844576.011217:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267874048:12345-0@lo:400:kworker.0 Request processed in 42us (5970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844576.011223:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788844576.012696:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267874176 00000100:00100000:3.0:1788844576.012717:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267874176 00000100:00080000:3.0:1788844576.012739:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788844576.012827:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267874304 00000100:00100000:3.0:1788844576.012831:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267874304 00000100:00100000:3.0:1788844576.012857:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267874560 00000100:00100000:3.0:1788844576.012861:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267874560 00000100:00100000:3.0:1788844576.012880:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788844576.012889:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267874176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844576.012997:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267874176:12345-0@lo:400:kworker.0 Request processed in 109us (12270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844576.013005:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788844576.013024:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788844576.013030:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267874304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844576.013063:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267874304:12345-0@lo:400:kworker.0 Request processed in 33us (10647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844576.013082:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788844576.013096:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788844576.013114:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267874560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844576.013148:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267874560:12345-0@lo:400:kworker.0 Request processed in 46us (7776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844576.013154:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788844576.013171:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844576.013666:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844576.013742:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267874304:0@lo:400:kworker.0 00000100:00100000:1.0:1788844576.013782:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267874432 00000100:00100000:1.0:1788844576.013786:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267874432 00000100:00100000:1.0:1788844576.013900:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788844576.013909:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267874432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844576.014037:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267874432:12345-0@lo:400:kworker.0 Request processed in 129us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844576.014044:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788844576.014064:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788844576.014090:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed829b480 x1875739267874432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844576.014116:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267874432:0@lo:400:kworker.0 00000100:00100000:3.0:1788844576.016725:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267874176:0@lo:400:kworker.0 00010000:00080000:3.0:1788844576.016752:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed829bb80 x1875739267874688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844576.016764:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267874688:0@lo:400:kworker.0 00000100:00100000:2.0:1788844576.018149:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267874048:0@lo:400:kworker.0 00000100:00100000:2.0:1788844576.018171:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267874560:0@lo:400:kworker.0 00000100:00100000:1.0:1788844576.506402:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788844576.506434:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267874816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844576.506532:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844576.506640:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267874816 00000100:00100000:1.0:1788844576.506651:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267874816 00000100:00100000:1.0:1788844576.506728:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788844576.506740:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267874816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844576.507122:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844576.507199:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267874816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 452us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844576.507208:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788844576.507297:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8c700 x1875739267874816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844576.507321:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267874816:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788844576.955593:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844577.023070:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267874944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844577.023185:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844577.023297:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267874944 00000100:00100000:2.0:1788844577.023307:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267874944 00000100:00100000:2.0:1788844577.023376:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788844577.023388:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267874944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844577.023433:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844577.023487:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267874944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844577.023504:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788844577.023585:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8287b80 x1875739267874944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844577.023607:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267874944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788844577.979163:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844579.002135:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844580.030755:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844580.810019:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844580.810063:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844580.810092:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844580.810111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844580.810137:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844580.810169:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244770816 00000100:00100000:2.0:1788844580.810179:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244770816 00000100:00100000:2.0:1788844580.810243:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244770688 00000100:00100000:2.0:1788844580.810247:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244770688 00000100:00100000:2.0:1788844580.810274:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:2.0:1788844580.810285:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244770816:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844580.810363:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244770816:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844580.810371:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:2.0:1788844580.810392:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:2.0:1788844580.810399:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244770688:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844580.810426:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244770688:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844580.810432:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:2.0:1788844580.810451:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244771072 00000100:00100000:2.0:1788844580.810455:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244771072 00000100:00100000:2.0:1788844580.810493:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244770944 00000100:00100000:2.0:1788844580.810498:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244770944 00000100:00100000:2.0:1788844580.810521:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:2.0:1788844580.810528:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244771072:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844580.810597:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244771072:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 69us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844580.810605:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:2.0:1788844580.810618:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:2.0:1788844580.810624:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244770944:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844580.810663:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244770944:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 38us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844580.810669:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00080000:2.0:1788844580.810694:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788844580.810824:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788844580.810829:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844580.811130:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244770560 00000100:00100000:1.0:1788844580.811135:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244770560 00000100:00100000:1.0:1788844580.811173:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 229 00000100:00100000:1.0:1788844580.811180:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244770560:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844580.811211:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244770560:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 32us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844580.811217:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 229 00010000:00010000:3.0:1788844581.049859:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844581.121429:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267875200:0@lo:400:kworker.0 00000100:00100000:2.0:1788844581.121501:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267875072:0@lo:400:kworker.0 00000100:00100000:3.0:1788844581.121508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844581.122058:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267875712:0@lo:400:kworker.0 00000100:00100000:0.0:1788844581.127772:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267875456:0@lo:400:kworker.0 00000100:00100000:2.0:1788844581.128114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844581.128144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844581.128171:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267875584:0@lo:400:kworker.0 00000100:00100000:2.0:1788844581.128203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844581.128244:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267875072 00000100:00100000:2.0:1788844581.128252:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267875072 00000100:00100000:3.0:1788844581.128271:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267875200 00000100:00100000:3.0:1788844581.128279:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267875200 00000100:00100000:2.0:1788844581.128303:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788844581.128314:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267875072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844581.128316:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267875584 00000100:00100000:3.0:1788844581.128322:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267875584 00000100:00100000:3.0:1788844581.128358:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788844581.128368:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267875200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844581.128376:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267875072:12345-0@lo:400:kworker.0 Request processed in 63us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844581.128389:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788844581.128434:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267875200:12345-0@lo:400:kworker.0 Request processed in 68us (6928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844581.128440:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788844581.128447:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788844581.128452:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267875584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844581.128475:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267875712 00000100:00100000:3.0:1788844581.128480:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267875712 00000100:00100000:2.0:1788844581.128491:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267875584:12345-0@lo:400:kworker.0 Request processed in 42us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844581.128498:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788844581.128514:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788844581.128524:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267875712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844581.128560:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267875072:0@lo:400:kworker.0 00000100:00100000:2.0:1788844581.128580:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267875584:0@lo:400:kworker.0 00000100:00100000:3.0:1788844581.128607:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267875712:12345-0@lo:400:kworker.0 Request processed in 83us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844581.128615:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788844581.128636:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788844581.128641:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788844581.128679:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d5500 x1875739267875712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844581.128691:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267875712:0@lo:400:kworker.0 00000100:00100000:3.0:1788844581.128704:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267875200:0@lo:400:kworker.0 00000100:00100000:0.0:1788844581.129580:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844581.129617:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788844581.129628:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267875328:0@lo:400:kworker.0 00000100:00100000:0.0:1788844581.129659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844581.129753:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267875328 00000100:00100000:3.0:1788844581.129760:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267875328 00000100:00100000:3.0:1788844581.129811:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788844581.129819:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267875328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844581.130648:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267875328:12345-0@lo:400:kworker.0 Request processed in 826us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844581.130658:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788844581.130720:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267875328:0@lo:400:kworker.0 00000100:00080000:0.0:1788844581.130803:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844581.131031:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267875456 00000100:00100000:2.0:1788844581.131037:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267875456 00000100:00080000:0.0:1788844581.131082:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844581.131104:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788844581.131113:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267875456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844581.131177:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267875456:12345-0@lo:400:kworker.0 Request processed in 66us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844581.131184:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788844581.131745:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb6d4700 x1875739267875456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844581.131763:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267875456:0@lo:400:kworker.0 00000100:00100000:1.0:1788844581.629515:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267875840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844581.629607:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844581.630603:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267875840 00000100:00100000:2.0:1788844581.630614:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267875840 00000100:00100000:2.0:1788844581.630667:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788844581.630678:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267875840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788844581.630717:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844581.630782:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267875840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844581.630789:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788844581.630830:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8e300 x1875739267875840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844581.630848:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267875840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788844582.073955:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844582.138112:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788844582.138136:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267875968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844582.138206:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844582.138268:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267875968 00000100:00100000:1.0:1788844582.138276:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267875968 00000100:00100000:1.0:1788844582.138336:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788844582.138364:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267875968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788844582.138401:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844582.138445:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267875968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844582.138452:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788844582.138505:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8c000 x1875739267875968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844582.138522:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267875968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788844583.098285:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844584.123526:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844585.149126:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844585.922626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844585.922658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844585.922678:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844585.922697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844585.922728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844585.922806:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244771200 00000100:00100000:0.0:1788844585.922815:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244771200 00000100:00100000:0.0:1788844585.922869:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 231 00000100:00100000:0.0:1788844585.922879:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2355:x1875739244771200:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844585.922971:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2355:x1875739244771200:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 93us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844585.922979:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 231 00000100:00100000:3.0:1788844585.923481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244771456 00000100:00100000:3.0:1788844585.923487:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244771456 00000100:00100000:3.0:1788844585.923530:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244771328 00000100:00100000:3.0:1788844585.923550:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244771328 00000100:00100000:3.0:1788844585.923577:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:3.0:1788844585.923585:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244771456:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844585.923623:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244771456:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 40us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844585.923630:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:3.0:1788844585.923645:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 91 00000100:00100000:3.0:1788844585.923651:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244771328:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844585.923675:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244771328:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 24us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844585.923681:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 91 00000100:00100000:3.0:1788844585.923703:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244771584 00000100:00100000:3.0:1788844585.923706:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244771584 00000100:00100000:3.0:1788844585.923730:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244771712 00000100:00100000:3.0:1788844585.923733:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244771712 00000100:00100000:3.0:1788844585.923751:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:3.0:1788844585.923757:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2353:x1875739244771584:12345-192.168.204.43@tcp:9:kworker.0 00000020:00000080:3.0:1788844585.923778:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9330 00000100:00080000:3.0:1788844585.923793:0:6687:0:(import.c:65:import_set_state_nolock()) ffff91eec71b4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788844585.923833:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788844585.924145:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+2:2353:x1875739244771584:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 385us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844585.924152:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:3.0:1788844585.924166:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:3.0:1788844585.924173:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2353:x1875739244771712:12345-192.168.204.43@tcp:9:kworker.0 00000020:00000080:3.0:1788844585.924185:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9337 00000100:00080000:3.0:1788844585.924191:0:6687:0:(import.c:65:import_set_state_nolock()) ffff91eeff240000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788844585.924212:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788844585.924407:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:89582201-bdf6-4401-b202-b9313c368ae5+2:2353:x1875739244771712:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 234us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844585.924414:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00010000:00010000:3.0:1788844585.924448:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844585.924453:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788844585.924660:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844585.924664:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844585.924667:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788844586.180298:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844586.234182:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267876096:0@lo:400:kworker.0 00000100:00100000:2.0:1788844586.234259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844586.234417:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267876224:0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.234452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844586.234473:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267876224 00000100:00100000:3.0:1788844586.234481:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267876224 00000100:00100000:0.0:1788844586.234496:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267876736:0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.234521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844586.234526:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788844586.234552:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267876224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.234578:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788844586.234584:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267876608:0@lo:400:kworker.0 00000100:00100000:3.0:1788844586.234605:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267876224:12345-0@lo:400:kworker.0 Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844586.234605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844586.234612:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788844586.234628:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267876608 00000100:00100000:3.0:1788844586.234630:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267876608 00000100:00100000:0.0:1788844586.234636:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267876224:0@lo:400:kworker.0 00000100:00100000:3.0:1788844586.234656:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788844586.234662:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267876608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.234670:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267876352:0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.234690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844586.234695:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267876608:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844586.234702:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844586.234706:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267876480:0@lo:400:kworker.0 00000100:00100000:3.0:1788844586.234708:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788844586.234718:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267876352 00000100:00100000:3.0:1788844586.234721:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267876352 00000100:00100000:0.0:1788844586.234725:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844586.234736:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788844586.234742:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267876352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.234754:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267876736 00000100:00100000:0.0:1788844586.234757:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267876736 00000100:00100000:3.0:1788844586.234773:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267876352:12345-0@lo:400:kworker.0 Request processed in 32us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844586.234779:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788844586.234794:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267876480 00000100:00100000:0.0:1788844586.234797:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267876480 00000100:00100000:0.0:1788844586.234831:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788844586.234837:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267876736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.234869:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267876736:12345-0@lo:400:kworker.0 Request processed in 33us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844586.234875:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788844586.234893:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788844586.234899:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267876480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.234936:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267876480:12345-0@lo:400:kworker.0 Request processed in 37us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844586.234941:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788844586.234959:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844586.234962:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844586.234969:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788844586.235219:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8298000 x1875739267876480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844586.235236:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267876480:0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.235247:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267876352:0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.235278:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267876608:0@lo:400:kworker.0 00010000:00080000:0.0:1788844586.235288:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aec700 x1875739267876736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844586.235295:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267876736:0@lo:400:kworker.0 00000100:00100000:1.0:1788844586.237664:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267876096 00000100:00100000:1.0:1788844586.237680:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267876096 00000100:00100000:0.0:1788844586.237946:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788844586.237958:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267876096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844586.238146:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267876096:12345-0@lo:400:kworker.0 Request processed in 190us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844586.238154:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788844586.238257:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267876096:0@lo:400:kworker.0 00000100:00100000:2.0:1788844586.752114:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267876864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844586.752186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844586.752271:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267876864 00000100:00100000:1.0:1788844586.752278:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267876864 00000100:00100000:1.0:1788844586.752325:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788844586.752334:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267876864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844586.752371:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844586.762918:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267876864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10573us (10720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844586.762933:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788844586.765619:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8c000 x1875739267876864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844586.765648:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267876864:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788844586.800485:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 89582201-bdf6-4401-b202-b9313c368ae5 00000020:00000080:1.0:1788844586.800494:0:7640:0:(genops.c:885:class_export_put()) final put ffff91eeff244000/89582201-bdf6-4401-b202-b9313c368ae5 00000020:00000080:3.0:1788844586.800686:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91eeff244000/89582201-bdf6-4401-b202-b9313c368ae5 for lustre-OST0001 00000020:00000080:3.0:1788844586.800735:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eeff240000 for lustre-OST0001 00010000:00010000:3.0:1788844587.193841:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844587.258157:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267876992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844587.258240:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844587.259670:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267876992 00000100:00100000:1.0:1788844587.259698:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267876992 00000100:00100000:1.0:1788844587.259775:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788844587.259800:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267876992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788844587.259837:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844587.259926:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267876992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844587.259949:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788844587.260174:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8c000 x1875739267876992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844587.260197:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267876992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788844588.218879:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844589.242389:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788844589.903201:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 89582201-bdf6-4401-b202-b9313c368ae5 00000020:00000080:2.0:1788844589.903218:0:6711:0:(genops.c:885:class_export_put()) final put ffff91eec71b7800/89582201-bdf6-4401-b202-b9313c368ae5 00000020:00000080:3.0:1788844589.903383:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec71b7800/89582201-bdf6-4401-b202-b9313c368ae5 for lustre-OST0000 00000020:00000080:3.0:1788844589.903805:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec71b4800 for lustre-OST0000 00010000:00010000:2.0:1788844590.268084:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844591.046443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844591.046504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844591.046578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844591.046617:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244771968 00000100:00100000:3.0:1788844591.046629:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244771968 00000100:00100000:3.0:1788844591.046702:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244772096 00000100:00100000:3.0:1788844591.046706:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244772096 00000100:00100000:3.0:1788844591.046733:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 95 00000100:00100000:3.0:1788844591.046743:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244771968:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844591.046874:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244771968:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 132us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844591.046883:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 95 00000100:00100000:3.0:1788844591.046904:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 96 00000100:00100000:3.0:1788844591.046910:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2357:x1875739244772096:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844591.046936:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2357:x1875739244772096:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844591.046942:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 96 00000100:00080000:3.0:1788844591.046960:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844591.047163:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244771840 00000100:00100000:1.0:1788844591.047168:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244771840 00000100:00100000:1.0:1788844591.047210:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 233 00000100:00100000:1.0:1788844591.047218:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244771840:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844591.047259:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244771840:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 42us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844591.047266:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 233 00000001:02000400:3.0:1788844591.218792:0:11010:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788844591.290851:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844591.361863:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267877120:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.361974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844591.362038:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267877632:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.362070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844591.362101:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788844591.362107:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267877248:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.362156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844591.362194:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267877760:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.362221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844591.362255:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267877376:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.362278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844591.362312:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844591.362318:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267877504:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.362340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844591.362733:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267877632 00000100:00100000:2.0:1788844591.362744:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267877632 00000100:00100000:3.0:1788844591.363511:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267877248 00000100:00100000:3.0:1788844591.363523:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267877248 00000100:00100000:3.0:1788844591.363599:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267877376 00000100:00100000:3.0:1788844591.363602:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267877376 00000100:00100000:3.0:1788844591.363626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788844591.363637:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267877632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844591.363744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267877632:12345-0@lo:400:kworker.0 Request processed in 108us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844591.363752:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788844591.363775:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788844591.363782:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267877248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844591.363823:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267877248:12345-0@lo:400:kworker.0 Request processed in 42us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844591.363829:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788844591.363843:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788844591.363849:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267877376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844591.363899:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267877376:12345-0@lo:400:kworker.0 Request processed in 50us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844591.363905:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788844591.363926:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844591.366780:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267877120 00000100:00100000:0.0:1788844591.366815:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267877120 00000100:00100000:0.0:1788844591.366886:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788844591.366897:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267877120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844591.367012:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267877120:12345-0@lo:400:kworker.0 Request processed in 117us (5039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844591.367020:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788844591.367276:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267877760 00000100:00100000:2.0:1788844591.367283:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267877760 00000100:00100000:2.0:1788844591.367473:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267877504 00000100:00100000:2.0:1788844591.367478:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267877504 00000100:00100000:2.0:1788844591.367505:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788844591.367513:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267877760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.367938:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267877760:12345-0@lo:400:kworker.0 Request processed in 425us (5714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844591.367946:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788844591.367966:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788844591.367974:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267877504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.368007:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267877504:12345-0@lo:400:kworker.0 Request processed in 35us (5666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844591.368013:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788844591.368044:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788844591.368049:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788844591.373628:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ef01673800 x1875739267877504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844591.373673:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267877504:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.373727:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267877376:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.373902:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267877248:0@lo:400:kworker.0 00010000:00080000:2.0:1788844591.373919:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ef01670000 x1875739267877760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844591.373930:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267877760:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.373942:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267877120:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.373954:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267877632:0@lo:400:kworker.0 00000100:00100000:2.0:1788844591.866003:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267877888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844591.866129:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844591.866698:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267877888 00000100:00100000:3.0:1788844591.866712:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267877888 00000100:00100000:3.0:1788844591.866782:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788844591.866802:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267877888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844591.866850:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844591.866928:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267877888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844591.866936:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788844591.867037:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec5991880 x1875739267877888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844591.867061:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267877888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788844592.313730:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844592.378094:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844592.378118:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267878016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844592.378200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844592.378385:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267878016 00000100:00100000:1.0:1788844592.378394:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267878016 00000100:00100000:1.0:1788844592.378456:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788844592.378466:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267878016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788844592.378504:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844592.378583:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267878016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844592.378591:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788844592.378631:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeefc8e300 x1875739267878016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844592.378650:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267878016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788844593.343791:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844594.362894:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788844595.279651:0:11159:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1fa28a00 20000000:00000080:0.0:1788844595.279678:0:11159:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eefb621400 uarg=0000000000000000 20000000:01000000:0.0:1788844595.279756:0:11159:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788844595.279765:0:11159:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788844595.279771:0:11159:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788844595.289005:0:11160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788844595.289785:0:11159:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788844595.297526:0:11159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788844595.297985:0:11159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.298010:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5526e00/0x7f1093851e2d92ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d92e3 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.298020:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d92f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d92f1 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.298027:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5527a00/0x7f1093851e2d9306 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d92ff expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.298038:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec13a0e00/0x7f1093851e2d930d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f868 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.298072:0:11159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ef0205c200/0x7f1093851e2d9322 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8a0 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.298081:0:11159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.298145:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ef0205c200/0x7f1093851e2d9322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8a0 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.298166:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ef0205c200/0x7f1093851e2d9322 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8a0 expref: 12 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844595.298186:0:11159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875739267878144:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844595.298803:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec13a0e00/0x7f1093851e2d930d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f868 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.298814:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eec13a0e00/0x7f1093851e2d930d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f868 expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844595.298823:0:11159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01670000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875739267878272:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844595.298869:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5527a00/0x7f1093851e2d9306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d92ff expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.298878:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5527a00/0x7f1093851e2d9306 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d92ff expref: 18 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844595.298887:0:11159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01672680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875739267878400:0@lo:104: 00000100:00100000:2.0:1788844595.298933:0:11159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788844595.298995:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d92f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d92f1 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.299003:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d92f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d92f1 expref: 18 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844595.299012:0:11159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875739267878528:0@lo:104: 00000100:00100000:2.0:1788844595.299035:0:11159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788844595.299114:0:11159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5526e00/0x7f1093851e2d92ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d92e3 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844595.299122:0:11159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5526e00/0x7f1093851e2d92ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d92e3 expref: 18 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844595.299131:0:11159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875739267878656:0@lo:104: 00000100:00100000:2.0:1788844595.299153:0:11159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844595.302614:0:11159:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6ba9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788844595.302669:0:11159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875739267878144:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844595.302681:0:11159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01670000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875739267878272:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844595.305599:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267878400 00000100:00100000:1.0:1788844595.305621:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267878400 00000100:00100000:1.0:1788844595.305697:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267878528 00000100:00100000:1.0:1788844595.305700:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267878528 00000100:00100000:1.0:1788844595.305710:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267878656 00000100:00100000:1.0:1788844595.305713:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267878656 00000100:00100000:1.0:1788844595.305743:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788844595.305756:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:11159:x1875739267878400:12345-0@lo:104: 00010000:00010000:1.0:1788844595.305782:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.305923:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788844595.305931:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+5:11159:x1875739267878400:12345-0@lo:104: Request processed in 178us (6997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844595.305939:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788844595.305958:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788844595.305964:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:11159:x1875739267878528:12345-0@lo:104: 00010000:00010000:1.0:1788844595.305972:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306005:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788844595.306010:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:11159:x1875739267878528:12345-0@lo:104: Request processed in 47us (6975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844595.306016:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788844595.306027:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788844595.306032:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:11159:x1875739267878656:12345-0@lo:104: 00010000:00010000:1.0:1788844595.306063:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844595.306312:0:11159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01672680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875739267878400:0@lo:104: 00000100:00100000:3.0:1788844595.306324:0:11159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875739267878528:0@lo:104: 00010000:00010000:1.0:1788844595.306506:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788844595.306512:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:11159:x1875739267878656:12345-0@lo:104: Request processed in 479us (7358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844595.306519:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788844595.306577:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788844595.306585:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306593:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205da00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844595.306598:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306609:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844595.306618:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844595.306624:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788844595.306675:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306683:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788844595.306710:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306718:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205da00/0x7f1093851e2d92ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9306 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306755:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788844595.306759:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306765:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed99bb800 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844595.306769:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306776:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844595.306783:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844595.306788:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788844595.306804:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306809:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788844595.306816:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306823:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eed99bb800/0x7f1093851e2d92f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d92f8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306833:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844595.306837:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306853:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec13a1400 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844595.306856:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306863:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844595.306870:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844595.306875:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788844595.306890:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306895:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788844595.306912:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306919:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec13a1400/0x7f1093851e2d92e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d92ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.306935:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844595.306937:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844595.306939:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844595.306947:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844595.306972:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267878784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788844595.307027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844595.307075:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844595.307081:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267878912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788844595.307271:0:11159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11159:1875739267878656:0@lo:104: 00010000:00010000:3.0:1788844595.307309:0:11159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844595.307642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844595.308013:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267878784 00000100:00100000:3.0:1788844595.308021:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267878784 00010000:00010000:3.0:1788844595.308058:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5527a00/0x7f1093851e2d9306 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d92ff expref: 19 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844595.308098:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244772224 00000100:00100000:3.0:1788844595.308101:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244772224 00010000:00010000:3.0:1788844595.308114:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ef0205c200/0x7f1093851e2d9322 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8a0 expref: 13 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844595.308144:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788844595.308151:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d72450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267878784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788844595.308169:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844595.308175:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5527a00/0x7f1093851e2d9306 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d92ff expref: 19 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844595.308186:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5527a00/0x7f1093851e2d9306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d92ff expref: 19 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844595.308204:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5527a00/0x7f1093851e2d9306 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d92ff expref: 19 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844595.308231:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844595.308277:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d72450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:3305:x1875739267878784:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844595.308285:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788844595.308330:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:3.0:1788844595.308336:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244772224:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844595.308345:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844595.308349:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ef0205c200/0x7f1093851e2d9322 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8a0 expref: 13 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844595.308359:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ef0205c200/0x7f1093851e2d9322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8a0 expref: 13 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844595.308370:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ef0205c200/0x7f1093851e2d9322 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8a0 expref: 13 pid: 5831 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844595.308403:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844595.308452:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:2354:x1875739244772224:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 115us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844595.308458:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:1.0:1788844595.308997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844595.309053:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267878784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788844595.309070:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267879040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788844595.309105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844595.309145:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267878912 00000100:00100000:0.0:1788844595.309150:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267878912 00010000:00010000:0.0:1788844595.309175:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d92f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d92f1 expref: 18 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844595.309187:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267879040 00000100:00100000:0.0:1788844595.309190:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267879040 00010000:00010000:0.0:1788844595.309199:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5526e00/0x7f1093851e2d92ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d92e3 expref: 19 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844595.309210:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788844595.309216:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267878912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844595.309226:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844595.309230:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d92f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d92f1 expref: 19 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844595.309238:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d92f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d92f1 expref: 19 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844595.309250:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d92f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d92f1 expref: 19 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844595.309261:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844595.309302:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:3305:x1875739267878912:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844595.309309:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788844595.309324:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788844595.309330:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:3307:x1875739267879040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844595.309337:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844595.309342:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5526e00/0x7f1093851e2d92ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d92e3 expref: 17 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844595.309346:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267878912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844595.309350:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5526e00/0x7f1093851e2d92ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d92e3 expref: 17 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844595.309361:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526e00/0x7f1093851e2d92ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d92e3 expref: 17 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844595.309369:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844595.309410:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3307:x1875739267879040:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844595.309416:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788844595.309774:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267879040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788844595.313517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844595.315864:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244772352 00000100:00100000:1.0:1788844595.315892:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244772352 00010000:00010000:1.0:1788844595.315968:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec13a0e00/0x7f1093851e2d930d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f868 expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844595.316132:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:1.0:1788844595.316147:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5992d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:2355:x1875739244772352:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844595.316171:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844595.316179:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec13a0e00/0x7f1093851e2d930d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f868 expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316198:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec13a0e00/0x7f1093851e2d930d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f868 expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316228:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec13a0e00/0x7f1093851e2d930d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f868 expref: 12 pid: 5833 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316260:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316271:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316295:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316324:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316332:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316339:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316346:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65c00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844595.316351:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316361:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316396:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844595.316408:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844595.316414:0:11159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844595.316422:0:11159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844595.316429:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed0d65c00/0x7f1093851e2d933e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844595.316498:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5992d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:2355:x1875739244772352:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 354us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844595.316507:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 29 00010000:00010000:1.0:1788844595.386839:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844596.168383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844596.168440:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844596.168580:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244772480 00000100:00100000:2.0:1788844596.168595:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244772480 00000100:00100000:2.0:1788844596.168674:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 235 00000100:00100000:2.0:1788844596.168687:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:2357:x1875739244772480:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844596.169091:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:2357:x1875739244772480:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 405us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844596.169100:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 235 00000100:00100000:3.0:1788844596.169309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844596.184864:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244772736 00000100:00100000:0.0:1788844596.184890:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244772736 00000100:00100000:0.0:1788844596.185022:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244772608 00000100:00100000:0.0:1788844596.185026:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244772608 00000100:00100000:0.0:1788844596.185079:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:0.0:1788844596.185094:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2357:x1875739244772736:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844596.185878:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2357:x1875739244772736:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 783us (17432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844596.185891:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:0.0:1788844596.185921:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:0.0:1788844596.185950:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244772608:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844596.186198:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244772608:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 42us (16682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844596.186261:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00080000:2.0:1788844596.188112:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788844596.411091:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844596.474055:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267879168:0@lo:400:kworker.0 00000100:00100000:2.0:1788844596.474165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844596.474232:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267879680:0@lo:400:kworker.0 00000100:00100000:2.0:1788844596.474264:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844596.474294:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788844596.474310:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267879552:0@lo:400:kworker.0 00000100:00100000:2.0:1788844596.474350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844596.474393:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267879552 00000100:00100000:2.0:1788844596.474403:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267879552 00000100:00100000:2.0:1788844596.474470:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788844596.474481:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267879552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844596.474568:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267879552:12345-0@lo:400:kworker.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844596.474577:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788844596.474602:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788844596.474655:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed84d5c00 x1875739267879552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844596.474673:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267879552:0@lo:400:kworker.0 00000100:00100000:3.0:1788844596.475027:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267879168 00000100:00100000:3.0:1788844596.475033:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267879168 00000100:00100000:3.0:1788844596.475093:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788844596.475102:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3308:x1875739267879168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844596.475151:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3308:x1875739267879168:12345-0@lo:400:kworker.0 Request processed in 50us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844596.475158:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788844596.475496:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267879296:0@lo:400:kworker.0 00000100:00100000:1.0:1788844596.475575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844596.475765:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267879808:0@lo:400:kworker.0 00000100:00100000:1.0:1788844596.475817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844596.475844:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844596.475851:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267879424:0@lo:400:kworker.0 00000100:00100000:1.0:1788844596.475876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844596.475914:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267879680 00000100:00100000:1.0:1788844596.475921:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267879680 00000100:00100000:1.0:1788844596.475959:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267879296 00000100:00100000:1.0:1788844596.475962:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267879296 00000100:00100000:1.0:1788844596.475973:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267879424 00000100:00100000:1.0:1788844596.475976:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267879424 00000100:00100000:2.0:1788844596.476100:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788844596.476112:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267879680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844596.476163:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267879680:12345-0@lo:400:kworker.0 Request processed in 54us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844596.476170:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788844596.476186:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788844596.476192:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267879296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844596.476240:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267879296:12345-0@lo:400:kworker.0 Request processed in 48us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844596.476247:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788844596.476287:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267879296:0@lo:400:kworker.0 00000100:00080000:2.0:1788844596.476330:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844596.476349:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267879168:0@lo:400:kworker.0 00000100:00100000:2.0:1788844596.476360:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267879680:0@lo:400:kworker.0 00000100:00100000:1.0:1788844596.477167:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788844596.477181:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267879424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844596.477239:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267879424:12345-0@lo:400:kworker.0 Request processed in 64us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844596.477247:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788844596.477847:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267879808 00000100:00100000:0.0:1788844596.477858:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267879808 00000100:00100000:0.0:1788844596.477918:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788844596.477926:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267879808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844596.477973:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267879808:12345-0@lo:400:kworker.0 Request processed in 49us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844596.477980:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788844596.478109:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267879424:0@lo:400:kworker.0 00010000:00080000:2.0:1788844596.478129:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed84d7100 x1875739267879808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844596.478141:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267879808:0@lo:400:kworker.0 00000100:00080000:3.0:1788844596.478572:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788844596.740425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844596.740845:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244772864 00000100:00100000:3.0:1788844596.740859:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244772864 00000100:00100000:3.0:1788844596.740956:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 237 00000100:00100000:3.0:1788844596.740967:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:5599:x1875739244772864:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788844596.740989:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844596.741018:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0024200/0x7f1093851e2d9345 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f8ca expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844596.741069:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024200/0x7f1093851e2d9345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ca expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844596.741085:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0024200/0x7f1093851e2d9345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ca expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844596.741096:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024200, rc 0) 00000100:00100000:3.0:1788844596.741174:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244772864:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 208us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844596.741182:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 237 00000100:00100000:1.0:1788844596.744960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844596.745351:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244772992 00000100:00100000:3.0:1788844596.745365:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244772992 00000100:00100000:3.0:1788844596.745438:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 238 00000100:00100000:3.0:1788844596.745449:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244772992:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844596.745886:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244772992:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 435us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844596.745894:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 238 00000100:00100000:3.0:1788844596.751518:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844596.753388:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244773120 00000100:00100000:2.0:1788844596.753406:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244773120 00000100:00100000:2.0:1788844596.753487:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 239 00000100:00100000:2.0:1788844596.753500:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244773120:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844596.753850:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244773120:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 351us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844596.753860:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 239 00000100:00100000:1.0:1788844596.791291:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844596.791832:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244773248 00000100:00100000:3.0:1788844596.791847:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244773248 00000100:00100000:3.0:1788844596.791921:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 240 00000100:00100000:3.0:1788844596.791933:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244773248:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788844596.791966:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844596.791991:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d934c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f8d1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844596.792031:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d934c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d1 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844596.792045:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d934c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d1 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844596.792057:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025a00, rc 0) 00000100:00100000:3.0:1788844596.793713:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:5599:x1875739244773248:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 1759us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844596.793728:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 240 00000100:00100000:1.0:1788844596.807476:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844596.812732:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244773376 00000100:00100000:2.0:1788844596.812758:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244773376 00000100:00100000:2.0:1788844596.812915:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 241 00000100:00100000:2.0:1788844596.812928:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:5599:x1875739244773376:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844596.817091:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:5599:x1875739244773376:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 409us (6799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844596.817149:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 241 00000100:00100000:1.0:1788844596.828204:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844596.828369:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244773504 00000100:00100000:0.0:1788844596.828384:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244773504 00000100:00100000:0.0:1788844596.828455:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 242 00000100:00100000:0.0:1788844596.828468:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:5599:x1875739244773504:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844596.828800:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:5599:x1875739244773504:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 334us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844596.828810:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 242 00000100:00100000:3.0:1788844596.986253:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844596.986292:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267879936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844596.986408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844596.986530:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267879936 00000100:00100000:3.0:1788844596.989070:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267879936 00000100:00100000:3.0:1788844596.990146:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788844596.990170:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267879936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844596.991878:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844596.992025:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267879936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1860us (5611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844596.992036:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788844596.995263:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed84d7100 x1875739267879936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844596.995304:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267879936:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788844597.306293:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788844597.306301:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eefacdc000 from 7 10000000:01000000:2.0:1788844597.306307:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788844597.306354:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844597.306367:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844597.306379:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844597.306404:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3173480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788844597.306468:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844597.306518:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6ba9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788844597.306697:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267880064 00000100:00100000:0.0:1788844597.306705:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267880064 00000100:00100000:0.0:1788844597.306753:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788844597.306762:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267880064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844597.306774:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844597.306788:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5526c00/0x7f1093851e2d935a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9353 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844597.306823:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526c00/0x7f1093851e2d935a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9353 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844597.306833:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5526c00/0x7f1093851e2d935a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9353 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844597.306842:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526c00, rc 0) 00000100:00100000:0.0:1788844597.306878:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267880064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844597.306884:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788844597.306986:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3173480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844597.307002:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844597.307011:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844597.307064:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3173480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844597.307095:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844597.307118:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6ba9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788844597.307185:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267880192 00000100:00100000:0.0:1788844597.307198:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267880192 00000100:00100000:0.0:1788844597.307224:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788844597.307230:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267880192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844597.307466:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267880192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844597.307473:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788844597.307906:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3173480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844597.307942:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3173480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844597.307995:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844597.308013:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6ba9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788844597.308028:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267880320 00000100:00100000:2.0:1788844597.308032:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267880320 00000100:00100000:2.0:1788844597.308059:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788844597.308066:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267880320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844597.308320:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267880320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844597.308327:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788844597.308372:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3173480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788844597.310363:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788844597.310562:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788844597.310586:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788844597.310598:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844597.310609:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844597.310620:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788844597.310623:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eef3110000 from 7 10000000:01000000:2.0:1788844597.310625:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788844597.310663:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844597.310694:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844597.310708:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844597.310733:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3173480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788844597.310790:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844597.310824:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6ba9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788844597.311053:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267880448 00000100:00100000:0.0:1788844597.311061:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267880448 00000100:00100000:0.0:1788844597.311106:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788844597.311116:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267880448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844597.311128:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844597.311139:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5526400/0x7f1093851e2d9368 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d9361 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844597.311163:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526400/0x7f1093851e2d9368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d9361 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844597.311180:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5526400/0x7f1093851e2d9368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9361 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844597.314124:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526400, rc 0) 00000100:00100000:0.0:1788844597.314241:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267880448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3116us (3439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844597.314251:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788844597.314323:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3173480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844597.314350:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844597.314363:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844597.314443:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844597.314475:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844597.314504:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1788844597.314521:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267880576 00000100:00100000:0.0:1788844597.314526:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267880576 00000100:00100000:0.0:1788844597.314579:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788844597.314587:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267880576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844597.314850:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267880576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844597.314858:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788844597.314889:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844597.314930:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844597.314966:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844597.314979:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1788844597.314991:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267880704 00000100:00100000:0.0:1788844597.314995:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267880704 00000100:00100000:0.0:1788844597.315013:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788844597.315019:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267880704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844597.315152:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267880704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844597.315160:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788844597.315198:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788844597.315870:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788844597.315918:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788844597.315930:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788844597.315939:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844597.315948:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844597.315959:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788844597.315962:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eed0c68800 from 7 10000000:01000000:0.0:1788844597.315965:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788844597.315991:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844597.322023:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844597.322064:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844597.322095:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788844597.322171:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844597.322320:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59dff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788844597.331995:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267880832 00000100:00100000:1.0:1788844597.332013:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267880832 00000100:00100000:1.0:1788844597.332129:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788844597.332139:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267880832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844597.332158:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844597.332178:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d9376 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d936f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844597.332232:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d9376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d936f expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844597.332244:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d9376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d936f expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844597.332255:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bae00, rc 0) 00000100:00100000:1.0:1788844597.332338:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267880832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (10167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844597.332345:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788844597.344080:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed829bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844597.344111:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844597.344124:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844597.344225:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844597.344290:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844597.344335:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788844597.344448:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267880960 00000100:00100000:2.0:1788844597.344457:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267880960 00000100:00100000:2.0:1788844597.344509:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788844597.344519:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267880960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844597.345111:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267880960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 590us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844597.345121:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788844597.345241:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267880960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844597.345278:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267881088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844597.345328:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844597.345358:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844597.345459:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267881088 00000100:00100000:0.0:1788844597.345465:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267881088 00000100:00100000:0.0:1788844597.345504:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788844597.345513:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267881088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844597.345716:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267881088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844597.345722:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788844597.345935:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267881088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788844597.349053:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788844597.349565:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788844597.349670:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788844597.349696:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844597.349709:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844597.433800:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844597.501041:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267881216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844597.501131:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844597.501312:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267881216 00000100:00100000:3.0:1788844597.501330:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267881216 00000100:00100000:3.0:1788844597.501398:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788844597.501407:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267881216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844597.501462:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844597.516754:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267881216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15337us (15612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844597.516778:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788844597.521532:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eef3170a80 x1875739267881216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844597.521584:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267881216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788844598.459288:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844599.495033:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788844600.361320:0:11357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788844600.507458:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844601.287622:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844601.287726:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244773632 00000100:00100000:2.0:1788844601.287736:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244773632 00000100:00100000:2.0:1788844601.287798:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 252 00000100:00100000:2.0:1788844601.287810:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2356:x1875739244773632:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844601.287883:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844601.287899:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2356:x1875739244773632:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 90us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844601.287907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 252 00000100:00100000:2.0:1788844601.287961:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244773760 00000100:00100000:2.0:1788844601.287978:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244773760 00000100:00100000:1.0:1788844601.287983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844601.288011:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244773888 00000100:00100000:1.0:1788844601.288016:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244773888 00000100:00100000:2.0:1788844601.288029:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 105 00000100:00100000:2.0:1788844601.288039:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244773760:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844601.288054:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 106 00000100:00100000:1.0:1788844601.288065:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+5:2356:x1875739244773888:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844601.288080:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244773760:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844601.288087:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 105 00000100:00100000:1.0:1788844601.288110:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+5:2356:x1875739244773888:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 46us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844601.288117:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 106 00000100:00080000:3.0:1788844601.290302:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788844601.529931:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844601.597651:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788844601.597675:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267881472:0@lo:400:kworker.0 00000100:00100000:2.0:1788844601.597676:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267881344:0@lo:400:kworker.0 00000100:00100000:3.0:1788844601.598311:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267881984:0@lo:400:kworker.0 00000100:00100000:0.0:1788844601.599242:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267881728:0@lo:400:kworker.0 00000100:00100000:1.0:1788844601.599347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844601.599430:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267881600:0@lo:400:kworker.0 00000100:00100000:1.0:1788844601.599457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844601.599509:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267881472 00000100:00100000:1.0:1788844601.599517:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267881472 00000100:00100000:1.0:1788844601.599592:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267881600 00000100:00100000:1.0:1788844601.599595:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267881600 00000100:00100000:1.0:1788844601.599639:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788844601.599647:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267881472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844601.599700:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267881472:12345-0@lo:400:kworker.0 Request processed in 54us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844601.599707:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788844601.599722:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788844601.599728:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267881600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844601.599756:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267881600:12345-0@lo:400:kworker.0 Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844601.599761:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788844601.599776:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844601.599813:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267881600:0@lo:400:kworker.0 00000100:00100000:1.0:1788844601.599824:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267881472:0@lo:400:kworker.0 00000100:00100000:2.0:1788844601.600518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844601.600626:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267881344 00000100:00100000:1.0:1788844601.600632:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267881344 00000100:00100000:1.0:1788844601.600662:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788844601.600668:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267881344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844601.601039:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267881856:0@lo:400:kworker.0 00000100:00100000:2.0:1788844601.601074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844601.601106:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267881856 00000100:00100000:2.0:1788844601.601110:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267881856 00000100:00100000:2.0:1788844601.601144:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788844601.601151:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267881856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844601.601188:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267881856:12345-0@lo:400:kworker.0 Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844601.601194:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1788844601.601212:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844601.601237:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267881856:0@lo:400:kworker.0 00000100:00100000:1.0:1788844601.601802:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267881344:12345-0@lo:400:kworker.0 Request processed in 1132us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844601.601809:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788844601.601902:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267881344:0@lo:400:kworker.0 00000100:00100000:0.0:1788844601.605705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844601.606032:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267881728 00000100:00100000:2.0:1788844601.606042:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267881728 00000100:00100000:2.0:1788844601.606118:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788844601.606129:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267881728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844601.606200:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267881728:12345-0@lo:400:kworker.0 Request processed in 73us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844601.606219:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788844601.606386:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844601.606478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844601.607055:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267881984 00000100:00100000:0.0:1788844601.607062:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267881984 00000100:00100000:0.0:1788844601.607119:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788844601.607136:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267881984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844601.607196:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267881984:12345-0@lo:400:kworker.0 Request processed in 62us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844601.607202:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788844601.607242:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec6aef480 x1875739267881728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844601.607257:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267881728:0@lo:400:kworker.0 00000100:00080000:1.0:1788844601.607387:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788844601.609481:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eef3e21500 x1875739267881984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844601.609499:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267881984:0@lo:400:kworker.0 00000100:00100000:3.0:1788844602.105785:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267882112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844602.105882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844602.106004:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267882112 00000100:00100000:3.0:1788844602.106014:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267882112 00000100:00100000:3.0:1788844602.106071:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788844602.106094:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267882112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844602.106137:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844602.106189:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267882112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844602.106197:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788844602.106244:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed84d7100 x1875739267882112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844602.106267:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267882112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788844602.554009:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844602.618004:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788844602.618037:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267882240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844602.618384:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844602.618474:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267882240 00000100:00100000:2.0:1788844602.618484:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267882240 00000100:00100000:2.0:1788844602.618568:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788844602.618580:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267882240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844602.618704:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844602.618827:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267882240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844602.618835:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788844602.618886:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eef3170700 x1875739267882240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844602.618909:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267882240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788844603.579291:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844604.602044:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788844604.617195:0:11456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:16:42 (1788844602) === 00000100:00100000:2.0:1788844604.888102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844604.888164:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844604.888250:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244774144 00000100:00100000:3.0:1788844604.888262:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244774144 00000100:00100000:3.0:1788844604.888345:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1788844604.888357:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:9682:x1875739244774144:12345-192.168.204.43@tcp:700:mkdir.0 00000100:00100000:3.0:1788844604.888456:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:9682:x1875739244774144:12345-192.168.204.43@tcp:700:mkdir.0 Request processed in 102us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844604.888465:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:0.0:1788844604.888573:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244774016 00000100:00100000:0.0:1788844604.888578:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244774016 00000100:00100000:0.0:1788844604.888611:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:0.0:1788844604.888617:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244774016:12345-192.168.204.43@tcp:41:mkdir.0 00000004:00000024:0.0:1788844604.888654:0:8217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788844604.888707:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244774016:12345-192.168.204.43@tcp:41:mkdir.0 Request processed in 90us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844604.888714:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00080000:2.0:1788844604.889154:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844604.894018:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844604.894276:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244774400 00000100:00100000:0.0:1788844604.894291:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244774400 00000100:00100000:0.0:1788844604.894361:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1788844604.894375:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:9682:x1875739244774400:12345-192.168.204.43@tcp:36:mkdir.0 00010000:00010000:0.0:1788844604.894460:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844604.894841:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d925e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f853 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.894883:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eed38cfe00) 00010000:00010000:0.0:1788844604.894898:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788844604.895336:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d937d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.895352:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d937d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.895364:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d937d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.897826:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.897852:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.897867:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844604.910478:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788844604.910503:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d937d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.910515:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d937d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.910524:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d937d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.910531:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844604.910565:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d937d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.910574:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d937d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.910611:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796200) 00010000:00010000:0.0:1788844604.910614:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844604.910620:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d937d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.910626:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d937d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788844604.910650:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fb7b9a5 reply state 00000000531b35a8 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844604.910871:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788844604.910998:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:9682:x1875739244774400:12345-192.168.204.43@tcp:36:mkdir.0 Request processed in 16622us (16995us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788844604.911007:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1788844604.937727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:2.0:1788844604.937742:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.937763:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844604.937769:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244774528 00000100:00100000:0.0:1788844604.937781:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244774528 00010000:00010000:2.0:1788844604.937795:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.937803:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844604.937810:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.937820:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.937848:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91eee1796100) 00000100:00100000:0.0:1788844604.937850:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00010000:00010000:2.0:1788844604.937857:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844604.937867:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844604.937871:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:9683:x1875739244774528:12345-192.168.204.43@tcp:101:chmod.0 00010000:00010000:2.0:1788844604.937883:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d9384 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.937901:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844604.937925:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2d938b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f8d8 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.938000:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d9392 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.938014:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d9392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.944336:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d9392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844604.944601:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788844604.944606:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788844604.944665:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d9392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.944707:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2d938b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d8 expref: 8 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.944729:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d9392 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d8 expref: 7 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.944739:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796900) 00010000:00010000:0.0:1788844604.944743:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788844604.944746:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527c00, rc 0) 00000100:00100000:0.0:1788844604.944825:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:9683:x1875739244774528:12345-192.168.204.43@tcp:101:chmod.0 Request processed in 6959us (7108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844604.944835:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:1.0:1788844604.951330:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844604.951462:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244774784 00000100:00100000:3.0:1788844604.951478:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244774784 00000100:00100000:3.0:1788844604.951809:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:3.0:1788844604.951825:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:9683:x1875739244774784:12345-192.168.204.43@tcp:36:chmod.0 00010000:00010000:3.0:1788844604.955465:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844604.955523:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d9392 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d8 expref: 7 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844604.955583:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844604.955598:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844604.955638:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844604.955655:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844604.955666:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788844604.956120:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002beaf05c reply state 000000004d42cbbd transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844604.956142:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788844604.956153:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788844604.956437:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:9683:x1875739244774784:12345-192.168.204.43@tcp:36:chmod.0 Request processed in 4612us (5117us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788844604.956447:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00010000:00010000:0.0:1788844604.975471:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.975496:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.975506:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.975575:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844604.975581:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.975591:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.975615:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:0.0:1788844604.975618:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788844604.975626:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844604.975633:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9399 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844604.983170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844604.983364:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244774912 00000100:00100000:2.0:1788844604.983380:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244774912 00000100:00100000:2.0:1788844604.983466:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:2.0:1788844604.983478:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:9684:x1875739244774912:12345-192.168.204.43@tcp:101:chown.0 00010000:00010000:2.0:1788844604.983516:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844604.983601:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d93a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f8df expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.983698:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d93a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.983739:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d93a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.983753:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d93a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844604.983802:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788844604.983807:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844604.983856:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d93a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.983889:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d93a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8df expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.983913:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d93a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8df expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.983925:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec2f43b00) 00010000:00010000:2.0:1788844604.983929:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844604.983934:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64400, rc 0) 00000100:00100000:2.0:1788844604.984018:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:9684:x1875739244774912:12345-192.168.204.43@tcp:101:chown.0 Request processed in 542us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844604.984027:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:1.0:1788844604.987800:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844604.987892:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244775040 00000100:00100000:2.0:1788844604.987916:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244775040 00000100:00100000:2.0:1788844604.987994:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1788844604.988008:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:9684:x1875739244775040:12345-192.168.204.43@tcp:101:chown.0 00010000:00010000:2.0:1788844604.988047:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844604.988101:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d93ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f8e6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988217:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d93b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988234:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d93b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988247:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d93b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988264:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d93bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988271:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d93bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988277:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d93bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988398:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65600/0x7f1093851e2d93c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988406:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65600/0x7f1093851e2d93c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988413:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65600/0x7f1093851e2d93c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844604.988454:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788844604.988458:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844604.988480:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65600/0x7f1093851e2d93c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988501:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d93b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988508:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d93b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988516:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d93b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988523:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844604.988528:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d93b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988600:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d93b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988617:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec2f43b00) 00010000:00010000:2.0:1788844604.988620:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844604.988626:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d93b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988633:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d93b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988647:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d93bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988653:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d93bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988658:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d93bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988671:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844604.988674:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d93bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988679:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d93bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988687:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91eec2f43900) 00010000:00010000:2.0:1788844604.988689:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844604.988692:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d93bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988697:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d93bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988734:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d93ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8e6 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988749:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65600/0x7f1093851e2d93c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8e6 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844604.988756:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eec2f43e00) 00010000:00010000:2.0:1788844604.988759:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844604.988761:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65600, rc 0) 00000100:00100000:2.0:1788844604.988835:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:9684:x1875739244775040:12345-192.168.204.43@tcp:101:chown.0 Request processed in 830us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844604.988842:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1788844604.993271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844604.993445:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244775296 00000100:00100000:3.0:1788844604.993460:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244775296 00000100:00100000:3.0:1788844604.993588:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:3.0:1788844604.993602:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:9684:x1875739244775296:12345-192.168.204.43@tcp:36:chown.0 00010000:00010000:3.0:1788844604.993681:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844604.993719:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65600/0x7f1093851e2d93c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8e6 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844604.993740:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eec2f43e00) 00010000:00010000:3.0:1788844604.993755:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844604.993789:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844604.993806:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844604.993818:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788844605.060758:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1788844605.060781:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788844605.060877:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024f17344 reply state 000000004173accb transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844605.060895:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788844605.060928:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788844605.061086:0:5840:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788844605.061111:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:9684:x1875739244775296:12345-192.168.204.43@tcp:36:chown.0 Request processed in 67506us (67850us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788844605.061122:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00010000:00010000:2.0:1788844605.064180:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.064205:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.064215:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.064222:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844605.064228:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.064237:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.064260:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:2.0:1788844605.064263:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788844605.064269:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.064276:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d93ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844605.078146:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844605.078268:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244775424 00000100:00100000:0.0:1788844605.078281:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244775424 00000100:00100000:0.0:1788844605.078354:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1788844605.078367:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:9685:x1875739244775424:12345-192.168.204.43@tcp:101:touch.500 00010000:00010000:0.0:1788844605.078400:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844605.078444:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2d93d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f8ed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788844605.080085:0:5838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1568us 00010000:00010000:0.0:1788844605.093997:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d93d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094021:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d93d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094032:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d93d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094051:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d93df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094059:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d93df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094066:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d93df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094413:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d93e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094422:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d93e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094430:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d93e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844605.094453:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788844605.094457:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788844605.094496:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d93e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094516:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d93d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094523:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d93d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094530:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d93d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094732:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844605.094738:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d93d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094746:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d93d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094758:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec2f43b00) 00010000:00010000:0.0:1788844605.094761:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844605.094766:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d93d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094772:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2d93d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094784:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d93df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094791:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d93df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094797:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d93df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094808:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844605.094811:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d93df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094818:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d93df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094826:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91eee1796700) 00010000:00010000:0.0:1788844605.094828:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844605.094832:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d93df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094838:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2d93df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094948:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2d93d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ed expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094966:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d93e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ed expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.094974:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eee1796200) 00010000:00010000:0.0:1788844605.094976:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788844605.094979:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526e00, rc 0) 00000100:00100000:0.0:1788844605.095049:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:9685:x1875739244775424:12345-192.168.204.43@tcp:101:touch.500 Request processed in 16684us (16918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844605.095058:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:3.0:1788844605.097632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844605.097771:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244775680 00000100:00100000:0.0:1788844605.097792:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244775680 00000100:00100000:0.0:1788844605.097896:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:0.0:1788844605.097907:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:9685:x1875739244775680:12345-192.168.204.43@tcp:101:touch.500 00010000:00010000:0.0:1788844605.097928:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844605.097950:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d93ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f8f4 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.098216:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d93f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.098230:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d93f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.098241:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d93f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.098305:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.098314:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.098321:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788844605.099077:0:8217:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788844605.099338:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9402 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099348:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099367:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099404:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d93f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099411:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d93f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099418:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d93f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099423:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844605.099427:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d93f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099433:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d93f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099443:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eee1796200) 00010000:00010000:0.0:1788844605.099446:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844605.099451:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d93f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099457:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d93f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788844605.099470:0:8217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ff11dc3 reply state 000000000e4353e0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844605.099479:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788844605.099518:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d93ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8f4 expref: 10 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099568:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9402 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8f4 expref: 9 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.099578:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eee1796900) 00010000:00010000:0.0:1788844605.099580:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788844605.099583:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031600, rc 0) 00000100:00100000:0.0:1788844605.099650:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:9685:x1875739244775680:12345-192.168.204.43@tcp:101:touch.500 Request processed in 1745us (2030us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788844605.099659:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00010000:00010000:0.0:1788844605.104454:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.104475:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.104483:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.104489:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844605.104494:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.104503:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.104519:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff91eee1796c00) 00010000:00010000:0.0:1788844605.104522:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844605.104593:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.104599:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d93fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844605.112451:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844605.112623:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244775936 00000100:00100000:2.0:1788844605.112639:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244775936 00000100:00100000:2.0:1788844605.112711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:2.0:1788844605.112724:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:9685:x1875739244775936:12345-192.168.204.43@tcp:36:touch.500 00010000:00010000:3.0:1788844605.112950:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844605.112993:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9402 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8f4 expref: 9 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.113050:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844605.113066:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844605.113130:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.113146:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.113158:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788844605.113343:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb7ca486 reply state 0000000011eee7d8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844605.113353:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788844605.113489:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:9685:x1875739244775936:12345-192.168.204.43@tcp:36:touch.500 Request processed in 766us (1052us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788844605.113499:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00010000:00010000:2.0:1788844605.117022:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.117062:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.117071:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.117077:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844605.117082:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.117089:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.117109:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:2.0:1788844605.117112:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844605.117117:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.117123:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9410 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844605.119323:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844605.119447:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244776064 00000100:00100000:0.0:1788844605.119462:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244776064 00000100:00100000:0.0:1788844605.119602:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:0.0:1788844605.119615:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:9685:x1875739244776064:12345-192.168.204.43@tcp:101:touch.500 00010000:00010000:0.0:1788844605.119649:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844605.119683:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9417 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f8fb expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.119783:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9417 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8fb expref: 10 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.119802:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9417 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8fb expref: 10 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.119828:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:0.0:1788844605.119831:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788844605.119836:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030000, rc 0) 00000100:00100000:0.0:1788844605.120072:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:9685:x1875739244776064:12345-192.168.204.43@tcp:101:touch.500 Request processed in 458us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844605.120079:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:1.0:1788844605.123214:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844605.123293:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244776192 00000100:00100000:2.0:1788844605.123319:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244776192 00000100:00100000:2.0:1788844605.123457:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:2.0:1788844605.123467:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1875739244776192:12345-192.168.204.43@tcp:8:touch.500 00010000:00080000:2.0:1788844605.123503:0:7066:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:2.0:1788844605.123663:0:7066:0:(genops.c:1385:class_connect()) connect: client 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1, cookie 0x7f1093851e2d941e 00002000:00100000:2.0:1788844605.123676:0:7066:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1/ffff91ef01668000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788844605.123718:0:7066:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788844605.124193:0:7066:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788844605.124229:0:7066:0:(import.c:65:import_set_state_nolock()) ffff91ef01669800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788844605.124306:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2353:x1875739244776192:12345-192.168.204.43@tcp:8:touch.500 Request processed in 839us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844605.124314:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:1.0:1788844605.129796:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844605.130131:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244776320 00000100:00100000:2.0:1788844605.130146:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244776320 00000100:00080000:1.0:1788844605.130297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844605.130344:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:2.0:1788844605.130358:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:0:x1875739244776320:12345-192.168.204.43@tcp:2:touch.500 00000001:00080000:0.0:1788844605.204837:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1788844605.204862:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000100:00100000:2.0:1788844605.207573:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:0:x1875739244776320:12345-192.168.204.43@tcp:2:touch.500 Request processed in 77177us (77753us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788844605.207591:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:3.0:1788844605.217345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844605.217488:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244776576 00000100:00100000:1.0:1788844605.217502:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244776576 00000100:00100000:1.0:1788844605.217610:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:1.0:1788844605.217622:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:9685:x1875739244776576:12345-192.168.204.43@tcp:35:touch.500 00000100:00100000:1.0:1788844605.221768:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+11:9685:x1875739244776576:12345-192.168.204.43@tcp:35:touch.500 Request processed in 4130us (4421us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788844605.221785:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:1.0:1788844605.249633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844605.249747:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244776704 00000100:00100000:2.0:1788844605.249761:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244776704 00000100:00100000:2.0:1788844605.249837:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:2.0:1788844605.249850:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+11:9686:x1875739244776704:12345-192.168.204.43@tcp:101:rm.0 00010000:00010000:2.0:1788844605.249882:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844605.249931:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d9425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f902 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.250042:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d942c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.250060:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d942c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.250075:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d942c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844605.250144:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788844605.250149:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844605.250197:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d942c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.250230:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d9425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f902 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.250253:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d942c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f902 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.250263:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eee1796200) 00010000:00010000:2.0:1788844605.250266:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844605.250270:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65000, rc 0) 00000100:00100000:2.0:1788844605.250357:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:9686:x1875739244776704:12345-192.168.204.43@tcp:101:rm.0 Request processed in 509us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844605.250365:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:2.0:1788844605.253981:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844605.254194:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244776960 00000100:00100000:0.0:1788844605.254227:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244776960 00000100:00100000:0.0:1788844605.254308:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:0.0:1788844605.254321:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:9686:x1875739244776960:12345-192.168.204.43@tcp:101:rm.0 00010000:00010000:0.0:1788844605.254348:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844605.254375:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f909 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844605.254496:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788844605.254759:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9433 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f909 expref: 14 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.254777:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec2f43b00) 00010000:00010000:0.0:1788844605.254780:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788844605.254786:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f909 expref: 14 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.254803:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030800, rc 0) 00000100:00100000:0.0:1788844605.254881:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:9686:x1875739244776960:12345-192.168.204.43@tcp:101:rm.0 Request processed in 564us (915us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788844605.254889:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:1.0:1788844605.261783:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844605.261950:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244777088 00000100:00100000:0.0:1788844605.261964:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244777088 00000100:00100000:0.0:1788844605.262228:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:0.0:1788844605.262241:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:9686:x1875739244777088:12345-192.168.204.43@tcp:37:rm.0 00000100:00100000:0.0:1788844605.270386:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:9686:x1875739244777088:12345-192.168.204.43@tcp:37:rm.0 Request processed in 8129us (8600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844605.270403:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:1.0:1788844605.279373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844605.279483:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244777344 00000100:00100000:0.0:1788844605.279497:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244777344 00000100:00100000:0.0:1788844605.279616:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:0.0:1788844605.279630:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:9686:x1875739244777344:12345-192.168.204.43@tcp:35:rm.0 00000100:00100000:0.0:1788844605.280237:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:9686:x1875739244777344:12345-192.168.204.43@tcp:35:rm.0 Request processed in 609us (878us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788844605.280247:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:2.0:1788844605.283936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844605.284209:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244777600 00000100:00100000:0.0:1788844605.284222:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244777600 00000100:00100000:0.0:1788844605.284301:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:0.0:1788844605.284313:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:9686:x1875739244777600:12345-192.168.204.43@tcp:101:rm.0 00010000:00010000:0.0:1788844605.284344:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844605.284372:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f910 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.284502:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d9448 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.284520:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d9448 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.284658:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d9448 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844605.284671:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788844605.284838:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f910 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.284861:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d9448 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f910 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.284889:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eee1796200) 00010000:00010000:0.0:1788844605.285249:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788844605.285257:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031000, rc 0) 00000100:00100000:0.0:1788844605.285402:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:9686:x1875739244777600:12345-192.168.204.43@tcp:101:rm.0 Request processed in 1089us (1486us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788844605.285411:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:1.0:1788844605.297168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844605.303263:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244777728 00000100:00100000:0.0:1788844605.303287:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244777728 00000100:00100000:2.0:1788844605.303526:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:2.0:1788844605.303570:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:9686:x1875739244777728:12345-192.168.204.43@tcp:41:rm.0 00000004:00000024:2.0:1788844605.303664:0:8217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788844605.303774:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:9686:x1875739244777728:12345-192.168.204.43@tcp:41:rm.0 Request processed in 206us (6621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844605.303783:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:1.0:1788844605.308929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844605.309258:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244777856 00000100:00100000:3.0:1788844605.309272:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244777856 00000100:00100000:3.0:1788844605.309351:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:3.0:1788844605.309365:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:9686:x1875739244777856:12345-192.168.204.43@tcp:101:rm.0 00010000:00010000:3.0:1788844605.309392:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844605.309420:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9456 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f917 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309566:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d945d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309585:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d945d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309599:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d945d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309617:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309624:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309630:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309762:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024600/0x7f1093851e2d946b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309771:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024600/0x7f1093851e2d946b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309778:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024600/0x7f1093851e2d946b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844605.309810:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788844605.309815:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844605.309845:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024600/0x7f1093851e2d946b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309873:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024600/0x7f1093851e2d946b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309883:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d945d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309890:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d945d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309910:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d945d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309925:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844605.309930:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d945d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309940:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d945d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309955:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eee1796200) 00010000:00010000:3.0:1788844605.309958:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844605.309963:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d945d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309969:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d945d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309986:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.309992:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9464 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.310004:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.310010:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844605.310013:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.310524:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9464 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.310577:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff91eed38cfe00) 00010000:00010000:3.0:1788844605.310580:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844605.310586:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9464 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.310593:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.310645:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9456 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f917 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.310662:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024600/0x7f1093851e2d946b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f917 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.310670:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:3.0:1788844605.310672:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844605.310675:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024600, rc 0) 00000100:00100000:3.0:1788844605.310775:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:9686:x1875739244777856:12345-192.168.204.43@tcp:101:rm.0 Request processed in 1413us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844605.310801:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:2.0:1788844605.314295:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844605.314518:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244778112 00000100:00100000:3.0:1788844605.314577:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244778112 00000100:00100000:3.0:1788844605.314650:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:3.0:1788844605.314662:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:9686:x1875739244778112:12345-192.168.204.43@tcp:36:rm.0 00010000:00010000:3.0:1788844605.314737:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788844605.314772:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024600/0x7f1093851e2d946b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f917 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.314806:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9417 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8fb expref: 16 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.314822:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:3.0:1788844605.314841:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d942c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f902 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.314850:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eee1796200) 00010000:00010000:3.0:1788844605.314853:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844605.315016:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9472 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.315092:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.315105:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.315124:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.315140:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.315148:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.315294:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9480 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.315303:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9480 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.315310:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9480 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788844605.317250:0:8217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788844605.317346:0:8217:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319595808483ns, next at 320595804035ns, rc = 0 00010000:00010000:2.0:1788844605.317453:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317471:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317489:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317497:0:8217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317503:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317509:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317579:0:8217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844605.317692:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9480 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317706:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9480 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317712:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9480 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317719:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844605.317724:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9480 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317755:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9480 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317770:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:2.0:1788844605.317774:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788844605.317780:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9480 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317786:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9480 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317812:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317818:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9472 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317825:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9472 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317830:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844605.317833:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9472 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317838:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9472 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317846:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eee1796200) 00010000:00010000:2.0:1788844605.317848:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844605.317852:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9472 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.317871:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9472 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788844605.317884:0:8217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001601640d reply state 00000000a94b60d4 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844605.318126:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844605.318135:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844605.318142:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844605.318145:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844605.318152:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844605.318174:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:1.0:1788844605.318177:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788844605.318180:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844605.318185:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9487 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844605.318206:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844605.318208:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844605.318210:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844605.318395:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844605.318706:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:9686:x1875739244778112:12345-192.168.204.43@tcp:36:rm.0 Request processed in 3862us (4241us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788844605.318720:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 30 00010000:00010000:0.0:1788844605.325992:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.326017:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.326037:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.326044:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844605.326050:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.326058:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.326082:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff91eed38cf900) 00010000:00010000:0.0:1788844605.326085:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844605.326092:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844605.326123:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9479 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844605.327463:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844605.327598:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244778368 00000100:00100000:1.0:1788844605.327611:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244778368 00000100:00100000:1.0:1788844605.327675:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:1.0:1788844605.327686:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:9686:x1875739244778368:12345-192.168.204.43@tcp:35:rm.0 00000100:00100000:1.0:1788844605.327992:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:9686:x1875739244778368:12345-192.168.204.43@tcp:35:rm.0 Request processed in 307us (540us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788844605.328001:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:1.0:1788844605.335975:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844605.336194:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244778624 00000100:00100000:2.0:1788844605.336207:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244778624 00000100:00100000:2.0:1788844605.336285:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:2.0:1788844605.336296:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:9686:x1875739244778624:12345-192.168.204.43@tcp:36:rm.0 00010000:00010000:2.0:1788844605.336375:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788844605.336412:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031000/0x7f1093851e2d9448 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f910 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.336442:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2d93e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ed expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.336455:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eee1796200) 00010000:00010000:2.0:1788844605.336474:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d93a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8df expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.336482:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec2f43b00) 00010000:00010000:2.0:1788844605.336509:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788844605.336588:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d948e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.336605:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d948e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.336617:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d948e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.336630:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.336636:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.336642:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.337166:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d949c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.337177:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d949c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.337185:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d949c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844605.337906:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788844605.337943:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d949c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.337951:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d949c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.337967:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d949c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.337974:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844605.337979:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d949c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.337989:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d949c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.338003:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91eec2f43100) 00010000:00010000:2.0:1788844605.338006:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788844605.338011:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d949c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.338017:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d949c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.338053:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d948e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.338059:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d948e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.338064:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d948e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.338070:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844605.338072:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d948e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.338088:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d948e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.338097:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec2f43900) 00010000:00010000:2.0:1788844605.338100:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844605.338102:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d948e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844605.338108:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d948e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788844605.338120:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000506b5f53 reply state 0000000004d39710 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844605.338129:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844605.338263:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:9686:x1875739244778624:12345-192.168.204.43@tcp:36:rm.0 Request processed in 1963us (2299us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788844605.338272:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 31 00010000:00010000:3.0:1788844605.351180:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.351210:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.351221:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.351229:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844605.351235:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.351245:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.351268:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91eec2f43500) 00010000:00010000:3.0:1788844605.351297:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844605.351304:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844605.351311:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9495 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844605.626920:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844606.410991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844606.411048:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844606.411163:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844606.411203:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844606.411255:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244778752 00000100:00100000:0.0:1788844606.411288:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244778752 00000100:00100000:0.0:1788844606.411377:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 254 00000100:00100000:0.0:1788844606.411389:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244778752:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844606.411595:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244778752:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 207us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844606.411604:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 254 00000100:00100000:0.0:1788844606.411647:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244779008 00000100:00100000:0.0:1788844606.411652:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244779008 00000100:00100000:0.0:1788844606.411688:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:0.0:1788844606.411696:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244779008:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844606.411727:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244779008:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 32us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844606.411734:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:1.0:1788844606.419958:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244778880 00000100:00100000:1.0:1788844606.419978:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244778880 00000100:00100000:1.0:1788844606.420109:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244779136 00000100:00100000:1.0:1788844606.420113:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244779136 00000100:00100000:1.0:1788844606.420154:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 110 00000100:00100000:1.0:1788844606.420166:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:2354:x1875739244778880:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844606.420284:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:2354:x1875739244778880:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 119us (9310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844606.420304:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 110 00000100:00080000:0.0:1788844606.420334:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844606.420340:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 111 00000100:00100000:1.0:1788844606.420350:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244779136:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844606.420380:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244779136:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 32us (9332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844606.420389:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 111 00010000:00010000:1.0:1788844606.649713:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844606.714071:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267882496:0@lo:400:kworker.0 00000100:00100000:3.0:1788844606.714183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844606.714295:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267882752:0@lo:400:kworker.0 00000100:00100000:3.0:1788844606.714575:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267883008:0@lo:400:kworker.0 00000100:00100000:0.0:1788844606.716252:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267882368:0@lo:400:kworker.0 00000100:00100000:1.0:1788844606.720845:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844606.720903:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267882752 00000100:00100000:1.0:1788844606.720915:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267882752 00000100:00100000:1.0:1788844606.721109:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788844606.721195:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267882752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844606.721346:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267882752:12345-0@lo:400:kworker.0 Request processed in 152us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844606.721355:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788844606.721492:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788844606.721589:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec4ff4000 x1875739267882752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844606.721607:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267882752:0@lo:400:kworker.0 00000100:00100000:3.0:1788844606.722444:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267882624:0@lo:400:kworker.0 00000100:00100000:3.0:1788844606.722524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844606.722622:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267882496 00000100:00100000:3.0:1788844606.722631:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267882496 00000100:00100000:3.0:1788844606.722673:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267882624 00000100:00100000:3.0:1788844606.722677:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267882624 00000100:00100000:3.0:1788844606.722713:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788844606.722721:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267882496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844606.722771:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267882496:12345-0@lo:400:kworker.0 Request processed in 51us (8589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844606.722779:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788844606.722795:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788844606.722802:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267882624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844606.722832:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267882624:12345-0@lo:400:kworker.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844606.722839:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788844606.722859:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844606.722905:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267882624:0@lo:400:kworker.0 00000100:00100000:3.0:1788844606.722948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844606.723004:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267882496:0@lo:400:kworker.0 00000100:00100000:0.0:1788844606.730801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844606.730934:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267882880:0@lo:400:kworker.0 00000100:00100000:0.0:1788844606.731004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844606.731063:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267882880 00000100:00100000:0.0:1788844606.731073:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267882880 00000100:00100000:0.0:1788844606.731155:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788844606.731166:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267882880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844606.731802:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267882880:12345-0@lo:400:kworker.0 Request processed in 630us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844606.731814:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788844606.731870:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267883008 00000100:00100000:0.0:1788844606.731877:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267883008 00000100:00100000:0.0:1788844606.731916:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788844606.731924:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267883008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844606.731980:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267883008:12345-0@lo:400:kworker.0 Request processed in 56us (9032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844606.731987:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788844606.732024:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844606.732031:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844606.732101:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267882880:0@lo:400:kworker.0 00010000:00080000:0.0:1788844606.732697:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec4ff6d80 x1875739267883008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844606.732712:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267883008:0@lo:400:kworker.0 00000100:00100000:3.0:1788844606.737590:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267882368 00000100:00100000:3.0:1788844606.737615:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267882368 00000100:00100000:3.0:1788844606.737687:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788844606.737700:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267882368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844606.737852:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267882368:12345-0@lo:400:kworker.0 Request processed in 154us (7062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844606.737861:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788844606.737935:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267882368:0@lo:400:kworker.0 00000100:00100000:2.0:1788844607.226320:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267883136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844607.226426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844607.226865:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267883136 00000100:00100000:1.0:1788844607.226878:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267883136 00000100:00100000:1.0:1788844607.226954:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788844607.226967:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267883136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844607.227037:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844607.227105:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267883136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844607.227113:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788844607.227164:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb395500 x1875739267883136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844607.227187:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267883136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788844607.682100:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788844607.742018:0:7026:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322020476658ns, next at 323020473515ns, rc = 0 00000100:00100000:3.0:1788844607.742047:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844607.742075:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267883264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844607.742178:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844607.742259:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267883264 00000100:00100000:3.0:1788844607.742270:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267883264 00000100:00100000:3.0:1788844607.742782:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788844607.742793:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267883264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844607.742843:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844607.742947:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267883264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844607.742956:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788844607.746106:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec4ff7100 x1875739267883264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844607.746143:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267883264:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788844608.698159:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844609.722749:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788844609.936231:0:11606:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:1.0:1788844610.401675:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:1.0:1788844610.401728:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:1.0:1788844610.401739:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788844610.401747:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:1.0:1788844610.401767:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788844610.402081:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267883392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788844610.402179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844610.402281:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267883392 00000100:00100000:1.0:1788844610.402290:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267883392 00000100:00100000:1.0:1788844610.402379:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788844610.402390:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267883392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788844610.402427:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00000100:00080000:0.0:1788844610.403173:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1788844610.403401:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f9a3c, atime: 0x6a9f9a3c, ctime: 0x6a9f9a3c, blocks: 0x1 00010000:00010000:1.0:1788844610.403511:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c97fb59b/0x7f1093851e2d94a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844610.404526:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1788844610.404565:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844610.404578:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c97fb59b/0x7f1093851e2d94a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844610.404607:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c97fb59b/0x7f1093851e2d94a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844610.404621:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c97fb59b/0x7f1093851e2d94a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844610.404629:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c97fb59b/0x7f1093851e2d94a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844610.404657:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844610.405818:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844610.405836:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c97fb59b/0x7f1093851e2d94a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844610.405874:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed99bb400 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844610.405880:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97fb59b/0x7f1093851e2d94a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844610.405891:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97fb59b/0x7f1093851e2d94a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844610.408153:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c97fb59b/0x7f1093851e2d94a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844610.408179:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c97fb59b/0x7f1093851e2d94a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844610.408218:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844610.408220:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844610.408223:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844610.408650:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875739267883392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6254us (6464us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788844610.408666:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788844610.408825:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eefb395500/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788844610.408834:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267883392:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788844610.765604:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788844611.278942:0:11654:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed0ed2700 20000000:00000080:1.0:1788844611.278967:0:11654:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eed819d400 uarg=0000000000000000 20000000:01000000:1.0:1788844611.279018:0:11654:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788844611.279027:0:11654:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788844611.279032:0:11654:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788844611.280228:0:11655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788844611.280436:0:11654:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788844611.294956:0:11654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788844611.295201:0:11654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788844611.295347:0:11654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788844611.295369:0:11654:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788844611.295396:0:11654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.295434:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0024200/0x7f1093851e2d9345 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ca expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.295454:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d934c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d1 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.295463:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5526c00/0x7f1093851e2d935a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9353 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.295470:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5526400/0x7f1093851e2d9368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d9361 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.295476:0:11654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d9376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d936f expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.295484:0:11654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.296679:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d9376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d936f expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.297321:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d9376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d936f expref: 18 pid: 5831 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844611.297345:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01622a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875739267883520:0@lo:104: 00000100:00100000:2.0:1788844611.297458:0:11654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788844611.297948:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5526400/0x7f1093851e2d9368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d9361 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.297960:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5526400/0x7f1093851e2d9368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d9361 expref: 18 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844611.297995:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01621880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875739267883648:0@lo:104: 00000100:00100000:2.0:1788844611.298039:0:11654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788844611.298239:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5526c00/0x7f1093851e2d935a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2d9353 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.298342:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91eec5526c00/0x7f1093851e2d935a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2d9353 expref: 18 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844611.298351:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01623800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875739267883776:0@lo:104: 00000100:00100000:2.0:1788844611.298381:0:11654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844611.298401:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267883520 00000100:00100000:0.0:1788844611.298411:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267883520 00000100:00100000:0.0:1788844611.298474:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267883648 00000100:00100000:0.0:1788844611.298477:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267883648 00000100:00100000:0.0:1788844611.298491:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788844611.298500:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:11654:x1875739267883520:12345-0@lo:104: 00010000:00010000:0.0:1788844611.298522:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298625:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788844611.298632:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+4:11654:x1875739267883520:12345-0@lo:104: Request processed in 133us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844611.298640:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788844611.298660:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788844611.298665:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:11654:x1875739267883648:12345-0@lo:104: 00010000:00010000:0.0:1788844611.298673:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298718:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788844611.298723:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:11654:x1875739267883648:12345-0@lo:104: Request processed in 58us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844611.298729:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788844611.298765:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788844611.298772:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298780:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527000 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844611.298786:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298795:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844611.298803:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844611.298810:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788844611.298853:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298859:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788844611.298883:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298890:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec5527000/0x7f1093851e2d936f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9376 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298906:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844611.298909:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298916:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64a00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844611.298919:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298925:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844611.298931:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844611.298936:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788844611.298949:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298956:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788844611.298962:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298980:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eed0d64a00/0x7f1093851e2d9361 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d9368 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.298990:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844611.298992:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844611.298993:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844611.299020:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267883904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788844611.299054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844611.299088:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788844611.299094:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267884032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788844611.299113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844611.299139:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267883904 00000100:00100000:0.0:1788844611.299143:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267883904 00010000:00010000:0.0:1788844611.299161:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d9376 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d936f expref: 19 pid: 5831 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844611.299181:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267884032 00000100:00100000:0.0:1788844611.299184:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267884032 00010000:00010000:0.0:1788844611.299195:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5526400/0x7f1093851e2d9368 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9361 expref: 20 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844611.299206:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788844611.299212:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+20:3305:x1875739267883904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844611.299223:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844611.299228:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d9376 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d936f expref: 20 pid: 5831 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.299252:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d9376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d936f expref: 20 pid: 5831 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.299282:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844611.299310:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+20:3305:x1875739267883904:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844611.299318:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788844611.299330:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788844611.299336:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267884032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844611.299343:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844611.299347:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5526400/0x7f1093851e2d9368 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9361 expref: 19 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.299357:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5526400/0x7f1093851e2d9368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d9361 expref: 19 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.299367:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844611.299386:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267884032:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844611.299392:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788844611.299442:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267884032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788844611.299452:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267883904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788844611.299747:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844611.301108:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d934c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d1 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.301132:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d934c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d1 expref: 12 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844611.301151:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01620380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875739267884160:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844611.301255:0:11654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0024200/0x7f1093851e2d9345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ca expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844611.301265:0:11654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eec0024200/0x7f1093851e2d9345 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ca expref: 12 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844611.301274:0:11654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01620a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875739267884288:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844611.301301:0:11654:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788844611.301332:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d9376 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d936f expref: 18 pid: 5831 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844611.301366:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01622a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875739267883520:0@lo:104: 00010000:00010000:2.0:1788844611.301381:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526400/0x7f1093851e2d9368 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d9361 expref: 17 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844611.301389:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01621880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875739267883648:0@lo:104: 00000100:00100000:0.0:1788844611.301848:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788844611.301866:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267883776 00000100:00100000:0.0:1788844611.301874:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267883776 00000100:00100000:0.0:1788844611.301934:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788844611.301943:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef4ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:11654:x1875739267883776:12345-0@lo:104: 00010000:00010000:0.0:1788844611.301958:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.302064:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788844611.302070:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef4ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+3:11654:x1875739267883776:12345-0@lo:104: Request processed in 129us (3689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844611.302078:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788844611.302128:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844611.302135:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.302144:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65400 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844611.302149:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.302160:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844611.302169:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844611.302175:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788844611.302212:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.302220:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788844611.302323:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01623800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875739267883776:0@lo:104: 00010000:00010000:0.0:1788844611.303952:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.303972:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eed0d65400/0x7f1093851e2d9353 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2d935a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844611.304167:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267884416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788844611.304260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844611.304938:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267884416 00000100:00100000:1.0:1788844611.304952:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267884416 00010000:00010000:1.0:1788844611.304999:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5526c00/0x7f1093851e2d935a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9353 expref: 17 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844611.305049:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788844611.305060:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:3307:x1875739267884416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788844611.305081:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844611.305087:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5526c00/0x7f1093851e2d935a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2d9353 expref: 17 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844611.305101:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5526c00/0x7f1093851e2d935a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2d9353 expref: 17 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844611.305123:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526c00/0x7f1093851e2d935a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2d9353 expref: 17 pid: 5834 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844611.305141:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844611.305196:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3307:x1875739267884416:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844611.305204:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788844611.305304:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267884416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844611.305896:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844611.305901:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844611.305903:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844611.309439:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01620380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875739267884160:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844611.309461:0:11654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01620a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11654:1875739267884288:192.168.204.43@tcp:104: 00000100:00100000:0.0:1788844611.309992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844611.310251:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244779392 00000100:00100000:1.0:1788844611.310262:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244779392 00010000:00010000:1.0:1788844611.310315:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0024200/0x7f1093851e2d9345 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ca expref: 13 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844611.310641:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:1.0:1788844611.310654:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244779392:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844611.310674:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844611.310682:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0024200/0x7f1093851e2d9345 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ca expref: 13 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844611.310695:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0024200/0x7f1093851e2d9345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ca expref: 13 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844611.310721:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0024200/0x7f1093851e2d9345 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8ca expref: 13 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844611.310742:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844611.310812:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:2354:x1875739244779392:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 160us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844611.310820:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 33 00010000:00010000:2.0:1788844611.311201:0:11654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844611.312309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844611.312458:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244779264 00000100:00100000:3.0:1788844611.312479:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244779264 00010000:00010000:3.0:1788844611.312533:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d934c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d1 expref: 12 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844611.312601:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:3.0:1788844611.312610:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:2355:x1875739244779264:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844611.312631:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844611.312638:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d934c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d1 expref: 12 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312652:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d934c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d1 expref: 12 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312673:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0025a00/0x7f1093851e2d934c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f8d1 expref: 12 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312693:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312703:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312723:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312731:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312739:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312770:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312777:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65a00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844611.312782:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312791:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312818:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844611.312830:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844611.312886:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:2355:x1875739244779264:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 277us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844611.312894:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00010000:00010000:0.0:1788844611.313387:0:11654:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.313398:0:11654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844611.313405:0:11654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2d94aa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844611.522787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844611.522841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844611.522881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844611.522918:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244779520 00000100:00100000:0.0:1788844611.522930:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244779520 00000100:00100000:0.0:1788844611.522996:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244779776 00000100:00100000:0.0:1788844611.522999:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244779776 00000100:00100000:0.0:1788844611.523021:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:0.0:1788844611.523032:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244779520:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844611.523125:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244779520:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844611.523134:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:0.0:1788844611.523153:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:0.0:1788844611.523159:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+5:2357:x1875739244779776:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844611.523192:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+5:2357:x1875739244779776:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 34us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844611.523198:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00080000:0.0:1788844611.523216:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844611.523440:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244779648 00000100:00100000:2.0:1788844611.523446:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244779648 00000100:00100000:2.0:1788844611.523499:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:2.0:1788844611.523507:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244779648:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844611.523572:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244779648:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 66us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844611.523579:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00080000:0.0:1788844611.523725:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788844611.769887:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844611.834635:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267884672:0@lo:400:kworker.0 00000100:00100000:1.0:1788844611.834742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844611.834834:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267885184:0@lo:400:kworker.0 00000100:00100000:1.0:1788844611.834867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844611.834920:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844611.834927:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267884800:0@lo:400:kworker.0 00000100:00100000:1.0:1788844611.834952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844611.834983:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267884928:0@lo:400:kworker.0 00000100:00100000:1.0:1788844611.835307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844611.835351:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788844611.835357:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267884544:0@lo:400:kworker.0 00000100:00100000:1.0:1788844611.835394:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844611.835432:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267885056:0@lo:400:kworker.0 00000100:00100000:1.0:1788844611.835458:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844611.835498:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267885184 00000100:00100000:1.0:1788844611.835518:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267885184 00000100:00100000:1.0:1788844611.835621:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267884928 00000100:00100000:1.0:1788844611.835625:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267884928 00000100:00100000:1.0:1788844611.835651:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788844611.835662:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267885184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844611.835728:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267885184:12345-0@lo:400:kworker.0 Request processed in 67us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844611.835736:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788844611.835755:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788844611.835762:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267884928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844611.835789:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267884928:12345-0@lo:400:kworker.0 Request processed in 28us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844611.835795:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788844611.835817:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267884544 00000100:00100000:1.0:1788844611.835821:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267884544 00000100:00100000:1.0:1788844611.835845:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788844611.835851:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3307:x1875739267884544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844611.835877:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8485450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3307:x1875739267884544:12345-0@lo:400:kworker.0 Request processed in 26us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844611.835882:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788844611.835923:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267884672 00000100:00100000:1.0:1788844611.835934:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267884672 00000100:00100000:1.0:1788844611.835956:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267884800 00000100:00100000:1.0:1788844611.835958:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267884800 00000100:00100000:1.0:1788844611.835970:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267885056 00000100:00100000:1.0:1788844611.835972:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267885056 00000100:00100000:1.0:1788844611.835988:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788844611.835993:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267884672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844611.836217:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788844611.836228:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267884800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844611.836270:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267884800:12345-0@lo:400:kworker.0 Request processed in 46us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844611.836276:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788844611.836290:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788844611.836296:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267885056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844611.836322:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267885056:12345-0@lo:400:kworker.0 Request processed in 26us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844611.836338:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1788844611.836394:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788844611.836401:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788844611.836465:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267884544:0@lo:400:kworker.0 00000100:00100000:3.0:1788844611.836482:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267885056:0@lo:400:kworker.0 00000100:00100000:3.0:1788844611.836492:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267884928:0@lo:400:kworker.0 00000100:00100000:3.0:1788844611.836578:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267884800:0@lo:400:kworker.0 00010000:00080000:3.0:1788844611.836596:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eef3e21500 x1875739267885184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844611.836609:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267885184:0@lo:400:kworker.0 00000100:00100000:1.0:1788844611.837146:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267884672:12345-0@lo:400:kworker.0 Request processed in 1148us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844611.837156:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788844611.837826:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267884672:0@lo:400:kworker.0 00000100:00100000:0.0:1788844612.346017:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788844612.346053:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267885312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844612.346155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844612.347422:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267885312 00000100:00100000:1.0:1788844612.347441:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267885312 00000100:00100000:1.0:1788844612.347622:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788844612.347636:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267885312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844612.347762:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844612.347868:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267885312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 234us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844612.347876:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788844612.348365:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eed8298000 x1875739267885312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844612.348404:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267885312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844612.481818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844612.485375:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244779904 00000100:00100000:1.0:1788844612.485424:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244779904 00000100:00100000:1.0:1788844612.485646:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 257 00000100:00100000:1.0:1788844612.485661:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:5599:x1875739244779904:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844612.485698:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844612.485731:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d94b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f91e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844612.485805:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d94b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f91e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844612.485833:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d94b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f91e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844612.485844:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bae00, rc 0) 00000100:00100000:1.0:1788844612.485931:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8484450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244779904:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 274us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844612.485940:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 257 00000100:00100000:3.0:1788844612.490511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844612.498504:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244780032 00000100:00100000:0.0:1788844612.498527:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244780032 00000100:00100000:0.0:1788844612.498649:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 258 00000100:00100000:0.0:1788844612.498662:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244780032:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844612.501231:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8485c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244780032:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 2553us (10718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844612.501369:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 258 00000100:00100000:3.0:1788844612.505048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844612.508612:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244780160 00000100:00100000:0.0:1788844612.508636:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244780160 00000100:00100000:0.0:1788844612.508753:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 259 00000100:00100000:0.0:1788844612.508766:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244780160:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844612.509105:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244780160:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 339us (4071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844612.509115:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 259 00000100:00100000:3.0:1788844612.517479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844612.526245:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244780288 00000100:00100000:0.0:1788844612.526268:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244780288 00000100:00100000:0.0:1788844612.526363:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 260 00000100:00100000:0.0:1788844612.526377:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:9956:x1875739244780288:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788844612.528477:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:9956:x1875739244780288:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 2084us (10998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844612.528495:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 260 00000100:00100000:3.0:1788844612.540337:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844612.549249:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244780416 00000100:00100000:1.0:1788844612.549271:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244780416 00000100:00100000:1.0:1788844612.549814:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 261 00000100:00100000:1.0:1788844612.549830:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:9956:x1875739244780416:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788844612.550208:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:9956:x1875739244780416:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 381us (9886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844612.550217:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 261 00000100:00100000:3.0:1788844612.565268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844612.565412:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244780544 00000100:00100000:0.0:1788844612.565429:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244780544 00000100:00100000:0.0:1788844612.565514:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 262 00000100:00100000:0.0:1788844612.565527:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:5599:x1875739244780544:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844612.565615:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844612.565650:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0031200/0x7f1093851e2d94b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793f925 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844612.565693:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0031200/0x7f1093851e2d94b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f925 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844612.565708:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0031200/0x7f1093851e2d94b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f925 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844612.565720:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031200, rc 0) 00000100:00100000:0.0:1788844612.565809:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:5599:x1875739244780544:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 284us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844612.565817:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 262 00000100:00100000:3.0:1788844612.573911:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844612.574113:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244780672 00000100:00100000:1.0:1788844612.574127:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244780672 00000100:00100000:1.0:1788844612.574201:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 263 00000100:00100000:1.0:1788844612.574213:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:5599:x1875739244780672:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844612.574690:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:5599:x1875739244780672:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 476us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844612.574699:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 263 00000100:00100000:3.0:1788844612.577138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844612.577251:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244780800 00000100:00100000:2.0:1788844612.577265:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244780800 00000100:00100000:2.0:1788844612.577337:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 264 00000100:00100000:2.0:1788844612.577347:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:5599:x1875739244780800:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844612.577693:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:5599:x1875739244780800:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 346us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844612.577714:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 264 00000100:00100000:3.0:1788844612.584714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844612.584863:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244780928 00000100:00100000:0.0:1788844612.584887:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244780928 00000100:00100000:0.0:1788844612.584991:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 265 00000100:00100000:0.0:1788844612.585003:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:9959:x1875739244780928:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788844612.585347:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:9959:x1875739244780928:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 343us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844612.585356:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 265 00000100:00100000:3.0:1788844612.590712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844612.591025:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244781056 00000100:00100000:1.0:1788844612.591039:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244781056 00000100:00100000:1.0:1788844612.591112:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 266 00000100:00100000:1.0:1788844612.591124:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:9959:x1875739244781056:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788844612.591459:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:9959:x1875739244781056:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 335us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844612.591468:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 266 00010000:00010000:0.0:1788844612.793985:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844612.858047:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844612.858080:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267885440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844612.858197:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844612.858290:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267885440 00000100:00100000:3.0:1788844612.858299:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267885440 00000100:00100000:3.0:1788844612.858376:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788844612.858402:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875739267885440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844612.858453:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844612.858511:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875739267885440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844612.858519:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788844612.858575:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844612.858632:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267885440:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788844613.308464:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788844613.308478:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eefacdc000 from 7 10000000:01000000:2.0:1788844613.308484:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788844613.308602:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844613.308618:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844613.308632:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844613.308666:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01620a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267885568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788844613.308777:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844613.308862:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788844613.311819:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267885568 00000100:00100000:1.0:1788844613.311844:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267885568 00000100:00100000:1.0:1788844613.311954:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788844613.311966:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:5836:x1875739267885568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844613.311988:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844613.312012:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d94c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d94bf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844613.312048:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d94c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d94bf expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844613.312061:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d94c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d94bf expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844613.312071:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bbe00, rc 0) 00000100:00100000:1.0:1788844613.312194:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267885568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (3416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844613.312200:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788844613.312312:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01620a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267885568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844613.312336:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844613.312360:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844613.312468:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267885696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844613.312511:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844613.312749:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec5885900 going to sleep for 11 seconds 00000100:00100000:1.0:1788844613.318520:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267885696 00000100:00100000:1.0:1788844613.320908:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267885696 00000100:00100000:1.0:1788844613.321020:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788844613.321033:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267885696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844613.321530:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267885696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 497us (9015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844613.322927:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267885696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844613.322974:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788844613.323017:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267885824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844613.323106:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844613.323155:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec5885900 going to sleep for 11 seconds 00000100:00100000:2.0:1788844613.323880:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267885824 00000100:00100000:2.0:1788844613.323894:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267885824 00000100:00100000:2.0:1788844613.323968:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788844613.323978:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267885824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844613.324276:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267885824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 298us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844613.324284:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788844613.324699:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267885824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.334068:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11668:1875739267885952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844613.334206:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844613.334275:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844613.334473:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267885952 00000100:00100000:1.0:1788844613.334485:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267885952 00000100:00100000:1.0:1788844613.334597:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788844613.334609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:11668:x1875739267885952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844613.335274:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:11668:x1875739267885952:12345-0@lo:502:llog_process_th.0 Request processed in 663us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844613.335285:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788844613.337269:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11668:1875739267885952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788844613.337845:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844613.337867:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844613.337871:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788844613.337882:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91eefacdc000 00000020:00000080:3.0:1788844613.337886:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788844613.338112:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11668:1875739267886080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844613.338226:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844613.338280:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844613.338410:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267886080 00000100:00100000:0.0:1788844613.338421:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267886080 00000100:00100000:0.0:1788844613.338489:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788844613.338499:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:11668:x1875739267886080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788844613.338886:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:11668:x1875739267886080:12345-0@lo:502:llog_process_th.0 Request processed in 387us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844613.338895:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788844613.339236:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11668:1875739267886080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788844613.339272:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844613.339281:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844613.339284:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788844613.339289:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788844613.340036:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788844613.340065:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788844613.340082:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844613.340097:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844613.340110:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788844613.340114:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eef3110000 from 7 10000000:01000000:0.0:1788844613.340118:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788844613.340168:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844613.340177:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844613.340187:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844613.340211:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267886208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788844613.340273:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844613.340318:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec5885540 going to sleep for 11 seconds 00000100:00100000:1.0:1788844613.340394:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267886208 00000100:00100000:1.0:1788844613.340401:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267886208 00000100:00100000:1.0:1788844613.340450:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788844613.340459:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:5836:x1875739267886208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844613.340475:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844613.340490:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed99bb400/0x7f1093851e2d94d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d94cd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844613.340518:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed99bb400/0x7f1093851e2d94d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d94cd expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844613.340531:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed99bb400/0x7f1093851e2d94d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d94cd expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844613.340604:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99bb400, rc 0) 00000100:00100000:1.0:1788844613.340648:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267886208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844613.340654:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788844613.340755:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267886208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788844613.340773:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844613.340789:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844613.340870:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267886336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.340901:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844613.340936:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788844613.340986:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267886336 00000100:00100000:1.0:1788844613.340991:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267886336 00000100:00100000:1.0:1788844613.341023:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788844613.341029:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267886336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844613.341327:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267886336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844613.341336:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788844613.341591:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267886336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.341638:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267886464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.341687:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844613.341706:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788844613.341724:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267886464 00000100:00100000:3.0:1788844613.341727:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267886464 00000100:00100000:3.0:1788844613.341750:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788844613.341757:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267886464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.341921:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267886464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844613.341929:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788844613.341970:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267886464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.342203:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11669:1875739267886592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844613.342239:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844613.342258:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267886592 00000100:00100000:3.0:1788844613.342261:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267886592 00000100:00100000:3.0:1788844613.342284:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788844613.342291:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:11669:x1875739267886592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844613.342459:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:11669:x1875739267886592:12345-0@lo:502:llog_process_th.0 Request processed in 169us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844613.342466:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788844613.342494:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844613.342505:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11669:1875739267886592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788844613.342526:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844613.342569:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844613.342572:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788844613.342581:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91eef3110000 00000020:00000080:3.0:1788844613.342583:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788844613.342666:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11669:1875739267886720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844613.342699:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844613.342719:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267886720 00000100:00100000:3.0:1788844613.342722:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267886720 00000100:00100000:3.0:1788844613.342739:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788844613.342745:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:11669:x1875739267886720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844613.342857:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:11669:x1875739267886720:12345-0@lo:502:llog_process_th.0 Request processed in 111us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844613.342864:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788844613.342893:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844613.342907:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11669:1875739267886720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788844613.342925:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844613.342930:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844613.342932:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788844613.342935:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788844613.342993:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788844613.343017:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788844613.343028:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844613.343039:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844613.343052:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788844613.343054:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eed0c68800 from 7 10000000:01000000:3.0:1788844613.343058:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788844613.343088:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844613.343096:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844613.343104:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844613.343117:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267886848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.343146:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844613.343160:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844613.343170:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267886848 00000100:00100000:3.0:1788844613.343174:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267886848 00000100:00100000:3.0:1788844613.343189:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788844613.343194:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:5836:x1875739267886848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788844613.343202:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844613.343214:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0024600/0x7f1093851e2d94e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2d94db expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844613.343246:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024600/0x7f1093851e2d94e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2d94db expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844613.343257:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0024600/0x7f1093851e2d94e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2d94db expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844613.343267:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024600, rc 0) 00000100:00100000:3.0:1788844613.343292:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267886848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844613.343298:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788844613.343325:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267886848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788844613.343337:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844613.343346:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844613.343411:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267886976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.343436:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844613.343446:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844613.343455:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267886976 00000100:00100000:3.0:1788844613.343458:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267886976 00000100:00100000:3.0:1788844613.343471:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788844613.343475:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267886976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.343746:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267886976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844613.343763:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788844613.343794:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267886976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.343818:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267887104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.343855:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844613.343869:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844613.343881:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267887104 00000100:00100000:3.0:1788844613.343884:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267887104 00000100:00100000:3.0:1788844613.343903:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788844613.343909:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267887104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788844613.344039:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:5836:x1875739267887104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844613.344046:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788844613.344084:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:5836:1875739267887104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844613.353940:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01620380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11671:1875739267887232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844613.354067:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844613.354171:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788844613.354282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267887232 00000100:00100000:3.0:1788844613.354293:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267887232 00000100:00100000:3.0:1788844613.354415:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788844613.354438:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:11671:x1875739267887232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844613.354805:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:11671:x1875739267887232:12345-0@lo:502:llog_process_th.0 Request processed in 378us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844613.354815:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788844613.354924:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01620380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11671:1875739267887232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788844613.354966:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788844613.354979:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844613.354982:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788844613.354990:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91eed0c68800 00000020:00000080:2.0:1788844613.354993:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788844613.356531:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01620380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11671:1875739267887360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844613.357968:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844613.360579:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788844613.362506:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267887360 00000100:00100000:0.0:1788844613.362531:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267887360 00000100:00100000:2.0:1788844613.364396:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788844613.364418:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:11671:x1875739267887360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844613.364825:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:11671:x1875739267887360:12345-0@lo:502:llog_process_th.0 Request processed in 411us (6863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844613.364835:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788844613.366779:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01620380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:11671:1875739267887360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788844613.367078:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788844613.367094:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844613.367097:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788844613.367102:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788844613.367417:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788844613.367453:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788844613.367468:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844613.367492:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788844613.395420:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788844613.818110:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788844614.461160:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788844614.841739:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788844615.494969:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1788844615.865925:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844616.645986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844616.646116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844616.651154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844616.651250:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844616.651282:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244781440 00000100:00100000:1.0:1788844616.651295:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244781440 00000100:00100000:1.0:1788844616.651386:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:1.0:1788844616.651399:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2356:x1875739244781440:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844616.651507:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2356:x1875739244781440:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 110us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844616.651516:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00080000:1.0:1788844616.651714:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844616.651951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244781184 00000100:00100000:2.0:1788844616.651959:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244781184 00000100:00100000:2.0:1788844616.651994:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 282 00000100:00100000:2.0:1788844616.652002:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2356:x1875739244781184:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844616.652037:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2356:x1875739244781184:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 36us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844616.652044:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 282 00000100:00100000:3.0:1788844616.657712:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244781312 00000100:00100000:3.0:1788844616.657735:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244781312 00000100:00100000:2.0:1788844616.658267:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244781568 00000100:00100000:2.0:1788844616.658292:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244781568 00000100:00100000:2.0:1788844616.658344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:2.0:1788844616.658356:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2356:x1875739244781312:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844616.658486:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2356:x1875739244781312:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 127us (12513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844616.658496:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:2.0:1788844616.658518:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:2.0:1788844616.658525:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2356:x1875739244781568:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844616.658592:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2356:x1875739244781568:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 67us (12476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844616.658599:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00080000:1.0:1788844616.659158:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788844616.890748:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844616.954237:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267887488:0@lo:400:kworker.0 00000100:00100000:2.0:1788844616.954284:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267887616:0@lo:400:kworker.0 00000100:00100000:0.0:1788844616.954381:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267887872:0@lo:400:kworker.0 00000100:00100000:2.0:1788844616.958356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844616.958699:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267888128:0@lo:400:kworker.0 00000100:00100000:2.0:1788844616.958760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844616.958825:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788844616.958834:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267887744:0@lo:400:kworker.0 00000100:00100000:2.0:1788844616.958860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844616.958909:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267887616 00000100:00100000:2.0:1788844616.958919:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267887616 00000100:00100000:2.0:1788844616.958990:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267887744 00000100:00100000:2.0:1788844616.958994:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267887744 00000100:00100000:2.0:1788844616.959040:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788844616.959049:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267887616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844616.959920:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267887616:12345-0@lo:400:kworker.0 Request processed in 866us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844616.959950:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788844616.960282:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788844616.960293:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267887744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844616.960751:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267887744:12345-0@lo:400:kworker.0 Request processed in 83us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844616.960761:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1788844616.960867:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844616.960923:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267887744:0@lo:400:kworker.0 00000100:00100000:2.0:1788844616.960941:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267887616:0@lo:400:kworker.0 00000100:00100000:2.0:1788844616.961087:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267888128 00000100:00100000:2.0:1788844616.961096:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267888128 00000100:00100000:2.0:1788844616.961224:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788844616.961232:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267888128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844616.961295:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267888128:12345-0@lo:400:kworker.0 Request processed in 63us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844616.961301:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788844616.961333:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788844616.961367:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeff836d80 x1875739267888128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844616.961582:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267888128:0@lo:400:kworker.0 00000100:00100000:0.0:1788844616.967755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844616.967886:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267887872 00000100:00100000:2.0:1788844616.967904:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267887872 00000100:00100000:2.0:1788844616.968009:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788844616.968022:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267887872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844616.982122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844616.982402:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267888000:0@lo:400:kworker.0 00000100:00100000:3.0:1788844616.982497:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844616.982558:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267888000 00000100:00100000:3.0:1788844616.982568:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267888000 00000100:00100000:3.0:1788844616.982642:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788844616.982653:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267888000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844616.982719:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267888000:12345-0@lo:400:kworker.0 Request processed in 68us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844616.982727:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788844616.982781:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267888000:0@lo:400:kworker.0 00000100:00080000:3.0:1788844616.982848:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788844616.982853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844616.982890:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267887488 00000100:00100000:3.0:1788844616.982894:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267887488 00000100:00100000:3.0:1788844616.982923:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788844616.982930:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267887488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844616.987979:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267887488:12345-0@lo:400:kworker.0 Request processed in 5021us (5842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844616.988021:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788844616.988334:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267887488:0@lo:400:kworker.0 00000100:00100000:2.0:1788844616.988437:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267887872:12345-0@lo:400:kworker.0 Request processed in 20415us (20691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844616.988448:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788844616.988584:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788844616.988600:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eefb395500, transno 4294967300 00000100:00100000:1.0:1788844616.988674:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267887872:0@lo:400:kworker.0 00000100:00100000:2.0:1788844617.465939:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267888256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844617.466045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844617.466311:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267888256 00000100:00100000:1.0:1788844617.466322:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267888256 00000100:00100000:1.0:1788844617.466393:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788844617.466407:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267888256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844617.466461:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844617.466527:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267888256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844617.466557:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788844617.467356:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeff834000 x1875739267888256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844617.467383:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267888256:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788844617.916847:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844617.978151:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788844617.978192:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267888384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844617.978308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844617.978518:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267888384 00000100:00100000:3.0:1788844617.978530:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267888384 00000100:00100000:3.0:1788844617.978625:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788844617.978637:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267888384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844617.978688:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844617.978764:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267888384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844617.978772:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788844617.979043:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267888384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788844618.941136:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844619.963818:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844620.986001:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844621.765934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844621.765973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844621.766000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844621.766022:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244781696 00000100:00100000:2.0:1788844621.766037:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244781696 00000100:00100000:2.0:1788844621.766112:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 284 00000100:00100000:2.0:1788844621.766124:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244781696:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844621.766173:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844621.766230:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244781696:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 107us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844621.766239:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 284 00000100:00100000:2.0:1788844621.766280:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244781952 00000100:00100000:2.0:1788844621.766284:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244781952 00000100:00100000:2.0:1788844621.766326:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:2.0:1788844621.766334:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244781952:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:3.0:1788844621.769994:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844621.770255:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244781952:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 3907us (4267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844621.770275:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:2.0:1788844621.770335:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244781824 00000100:00100000:2.0:1788844621.770348:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244781824 00000100:00100000:3.0:1788844621.771824:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244782080 00000100:00100000:3.0:1788844621.771844:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244782080 00000100:00100000:3.0:1788844621.771957:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 125 00000100:00100000:3.0:1788844621.771969:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2357:x1875739244782080:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844621.772160:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2357:x1875739244782080:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 192us (5986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844621.772170:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 125 00000100:00080000:0.0:1788844621.772261:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844621.772937:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 126 00000100:00100000:2.0:1788844621.772951:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244781824:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844621.773017:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244781824:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 70us (7015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844621.773024:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 126 00010000:00010000:2.0:1788844622.010756:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844622.076729:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267888512:0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.076916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844622.077598:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267889024:0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.077649:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844622.077701:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788844622.077710:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267888896:0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.077750:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844622.078153:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267888640:0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.078196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844622.078334:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267888768:0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.078439:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267889152:0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.078468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844622.078653:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267888512 00000100:00100000:1.0:1788844622.078664:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267888512 00000100:00100000:1.0:1788844622.078731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788844622.078742:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267888512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844622.079015:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267888896 00000100:00100000:2.0:1788844622.079021:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267888896 00000100:00100000:1.0:1788844622.079215:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267888512:12345-0@lo:400:kworker.0 Request processed in 462us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844622.079225:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788844622.079275:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267889024 00000100:00100000:1.0:1788844622.079279:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267889024 00000100:00100000:1.0:1788844622.079311:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267888640 00000100:00100000:1.0:1788844622.079314:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267888640 00000100:00100000:1.0:1788844622.079337:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788844622.079345:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267889024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.079384:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267889024:12345-0@lo:400:kworker.0 Request processed in 40us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844622.079392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788844622.079407:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788844622.079413:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267888640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.079449:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267888640:12345-0@lo:400:kworker.0 Request processed in 35us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844622.079455:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788844622.079477:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267889152 00000100:00100000:1.0:1788844622.079501:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267889152 00000100:00100000:1.0:1788844622.079555:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788844622.079564:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267889152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.079598:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267889152:12345-0@lo:400:kworker.0 Request processed in 36us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844622.079605:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788844622.079662:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267888640:0@lo:400:kworker.0 00010000:00080000:1.0:1788844622.079679:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeff836300 x1875739267889152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844622.079704:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267889152:0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.079746:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267888512:0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.079758:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267889024:0@lo:400:kworker.0 00000100:00100000:2.0:1788844622.080232:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788844622.080245:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267888896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844622.080308:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267888896:12345-0@lo:400:kworker.0 Request processed in 68us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844622.080316:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788844622.080343:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788844622.080349:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788844622.080352:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844622.080382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844622.080430:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267888768 00000100:00100000:2.0:1788844622.080436:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267888768 00000100:00100000:2.0:1788844622.080469:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788844622.080476:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267888768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844622.080603:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267888768:12345-0@lo:400:kworker.0 Request processed in 127us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844622.080611:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788844622.080626:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844622.080654:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267888768:0@lo:400:kworker.0 00000100:00100000:2.0:1788844622.080701:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267888896:0@lo:400:kworker.0 00000100:00100000:1.0:1788844622.585947:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844622.585980:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267889280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844622.586086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844622.586824:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267889280 00000100:00100000:0.0:1788844622.586841:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267889280 00000100:00100000:0.0:1788844622.586906:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788844622.586919:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267889280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788844622.587123:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844622.587230:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267889280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 312us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844622.587238:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788844622.587597:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeff835880 x1875739267889280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844622.587622:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267889280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788844623.037193:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844623.097927:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844623.097970:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267889408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844623.098103:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844623.098505:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267889408 00000100:00100000:2.0:1788844623.098518:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267889408 00000100:00100000:2.0:1788844623.098621:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788844623.098634:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267889408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844623.098684:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844623.098760:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267889408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844623.098769:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788844623.098980:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267889408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788844624.058140:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788844624.702061:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788844625.081896:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844626.106527:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844626.885025:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844626.885122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844626.885218:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244782336 00000100:00100000:0.0:1788844626.885236:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244782336 00000100:00100000:3.0:1788844626.887357:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244782208 00000100:00100000:3.0:1788844626.887385:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244782208 00000100:00100000:3.0:1788844626.887496:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 286 00000100:00100000:3.0:1788844626.887506:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244782208:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844626.887641:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244782208:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 137us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844626.887648:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 286 00000100:00100000:0.0:1788844626.887839:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 130 00000100:00100000:0.0:1788844626.887848:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244782336:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844626.887896:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244782336:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 36us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844626.887903:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 130 00000100:00080000:3.0:1788844626.888063:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844626.914664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844626.914728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844626.914854:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244782464 00000100:00100000:1.0:1788844626.914868:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244782464 00000100:00100000:2.0:1788844626.914943:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244782592 00000100:00100000:2.0:1788844626.914960:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244782592 00000100:00100000:1.0:1788844626.915003:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:1.0:1788844626.915022:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2353:x1875739244782464:12345-192.168.204.43@tcp:9:kworker.0 00000100:00100000:2.0:1788844626.915062:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 131 00000020:00000080:1.0:1788844626.915065:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d941e 00000100:00100000:2.0:1788844626.915079:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2356:x1875739244782592:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:1.0:1788844626.915081:0:6686:0:(import.c:65:import_set_state_nolock()) ffff91ef01669800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788844626.915165:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788844626.915189:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2356:x1875739244782592:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 116us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844626.915197:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 131 00010000:00010000:2.0:1788844626.915395:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844626.916261:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+2:2353:x1875739244782464:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 1240us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844626.916273:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00080000:3.0:1788844626.916564:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788844626.916575:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788844627.132253:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844627.193900:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267889664:0@lo:400:kworker.0 00000100:00100000:1.0:1788844627.193973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844627.194029:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267890176:0@lo:400:kworker.0 00000100:00100000:1.0:1788844627.194073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844627.194121:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844627.194129:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267889792:0@lo:400:kworker.0 00000100:00100000:1.0:1788844627.194151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844627.194184:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267890176 00000100:00100000:1.0:1788844627.194191:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267890176 00000100:00100000:1.0:1788844627.194245:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788844627.194253:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267890176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844627.194300:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267890176:12345-0@lo:400:kworker.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844627.194308:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788844627.194330:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267889664 00000100:00100000:1.0:1788844627.194334:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267889664 00000100:00100000:1.0:1788844627.194354:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267889792 00000100:00100000:1.0:1788844627.194357:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267889792 00000100:00100000:1.0:1788844627.194374:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788844627.194379:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267889664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844627.194416:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267889664:12345-0@lo:400:kworker.0 Request processed in 36us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844627.194423:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788844627.194446:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788844627.194454:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267889792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844627.194488:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267889792:12345-0@lo:400:kworker.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844627.194511:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788844627.194588:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267889792:0@lo:400:kworker.0 00000100:00100000:1.0:1788844627.194613:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267889664:0@lo:400:kworker.0 00000100:00080000:3.0:1788844627.194630:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788844627.194633:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eeff836a00 x1875739267890176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788844627.194640:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788844627.194649:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267890176:0@lo:400:kworker.0 00000100:00100000:2.0:1788844627.195242:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267889536:0@lo:400:kworker.0 00000100:00100000:2.0:1788844627.195285:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844627.195326:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267890048:0@lo:400:kworker.0 00000100:00100000:2.0:1788844627.195359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844627.195383:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788844627.195389:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267889920:0@lo:400:kworker.0 00000100:00100000:2.0:1788844627.195412:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844627.195439:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267890048 00000100:00100000:2.0:1788844627.195443:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267890048 00000100:00100000:2.0:1788844627.195477:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788844627.195484:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267890048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844627.195562:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267890048:12345-0@lo:400:kworker.0 Request processed in 53us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844627.195569:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788844627.195593:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844627.195624:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267890048:0@lo:400:kworker.0 00000100:00100000:1.0:1788844627.196094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267889536 00000100:00100000:1.0:1788844627.196101:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267889536 00000100:00100000:0.0:1788844627.196172:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267889920 00000100:00100000:1.0:1788844627.196173:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788844627.196187:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267889920 00000100:00100000:1.0:1788844627.196188:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267889536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844627.203560:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788844627.203580:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267889920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844627.203745:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267889536:12345-0@lo:400:kworker.0 Request processed in 7558us (8456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844627.203763:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:2.0:1788844627.212253:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788844627.213652:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267889920:12345-0@lo:400:kworker.0 Request processed in 10071us (18229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844627.213667:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788844627.216724:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267889920:0@lo:400:kworker.0 00000100:00100000:3.0:1788844627.216751:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267889536:0@lo:400:kworker.0 00000100:00100000:3.0:1788844627.707300:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844627.707335:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267890304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844627.707439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844627.708294:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267890304 00000100:00100000:2.0:1788844627.708308:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267890304 00000100:00100000:2.0:1788844627.708385:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788844627.708396:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267890304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788844627.708442:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844627.708526:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267890304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844627.708534:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788844627.708625:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec4ff5500 x1875739267890304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844627.708651:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267890304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788844628.153843:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844628.220325:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844628.220354:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267890432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844628.220433:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844628.220632:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267890432 00000100:00100000:2.0:1788844628.220654:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267890432 00000100:00100000:2.0:1788844628.220708:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788844628.220718:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267890432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844628.220755:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844628.220814:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267890432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844628.220821:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788844628.221038:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267890432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788844629.177975:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844629.955375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844629.955427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844629.955464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844629.955588:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244782848 00000100:00100000:3.0:1788844629.955599:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244782848 00000100:00100000:3.0:1788844629.955681:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244782976 00000100:00100000:3.0:1788844629.955685:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244782976 00000100:00100000:3.0:1788844629.955712:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 135 00000100:00100000:3.0:1788844629.955723:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244782848:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844629.955800:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244782848:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 79us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844629.955807:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 135 00000100:00100000:3.0:1788844629.955822:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 136 00000100:00100000:3.0:1788844629.955829:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244782976:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844629.955851:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244782976:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 23us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844629.955857:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 136 00000100:00100000:1.0:1788844629.956195:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244782720 00000100:00100000:1.0:1788844629.956201:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244782720 00000100:00100000:1.0:1788844629.956235:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 288 00000100:00100000:1.0:1788844629.956242:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244782720:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844629.956279:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244782720:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 38us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844629.956285:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 288 00000100:00080000:0.0:1788844629.956385:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788844630.201874:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788844630.837949:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:0.0:1788844630.837958:0:6711:0:(genops.c:885:class_export_put()) final put ffff91ef01668000/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:1.0:1788844630.838110:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91ef01668000/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 for lustre-OST0000 00000020:00000080:1.0:1788844630.838169:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ef01669800 for lustre-OST0000 00010000:00010000:2.0:1788844631.226472:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844632.007814:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844632.007847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844632.007882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844632.009079:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244783232 00000100:00100000:3.0:1788844632.009092:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244783232 00000100:00100000:3.0:1788844632.009147:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244783360 00000100:00100000:3.0:1788844632.009151:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244783360 00000100:00100000:3.0:1788844632.009176:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 137 00000100:00100000:3.0:1788844632.009185:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2355:x1875739244783232:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844632.009261:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2355:x1875739244783232:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 76us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844632.009268:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 137 00000100:00100000:3.0:1788844632.009291:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 138 00000100:00100000:3.0:1788844632.009297:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244783360:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844632.009318:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244783360:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 22us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844632.009332:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 138 00000100:00080000:3.0:1788844632.009353:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844632.010207:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244783104 00000100:00100000:3.0:1788844632.010215:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244783104 00000100:00100000:3.0:1788844632.010252:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 289 00000100:00100000:3.0:1788844632.010260:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2355:x1875739244783104:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844632.010301:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2355:x1875739244783104:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 42us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844632.010308:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 289 00010000:00010000:3.0:1788844632.250825:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844632.314992:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed856a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267890560:0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.315074:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844632.315119:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267891072:0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.315144:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844632.315167:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788844632.315173:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267890944:0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.315196:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844632.315225:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267890688:0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.315248:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844632.315272:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb3dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267891200:0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.315292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844632.315308:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788844632.315314:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267890816:0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.315333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844632.315364:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267890944 00000100:00100000:0.0:1788844632.315372:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267890944 00000100:00100000:0.0:1788844632.315420:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267891200 00000100:00100000:0.0:1788844632.315423:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267891200 00000100:00100000:0.0:1788844632.315446:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788844632.315454:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267890944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.315506:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267890944:12345-0@lo:400:kworker.0 Request processed in 52us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844632.315513:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788844632.315528:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788844632.315533:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267891200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.315588:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267891200:12345-0@lo:400:kworker.0 Request processed in 54us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844632.315594:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788844632.315636:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267890944:0@lo:400:kworker.0 00010000:00080000:0.0:1788844632.315666:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb3dd880 x1875739267891200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844632.315677:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb3dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267891200:0@lo:400:kworker.0 00000100:00100000:3.0:1788844632.316213:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267891072 00000100:00100000:3.0:1788844632.316220:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267891072 00000100:00100000:3.0:1788844632.316253:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267890688 00000100:00100000:3.0:1788844632.316256:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267890688 00000100:00100000:3.0:1788844632.316271:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267890816 00000100:00100000:3.0:1788844632.316273:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267890816 00000100:00100000:3.0:1788844632.316291:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788844632.316298:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267891072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844632.316347:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267891072:12345-0@lo:400:kworker.0 Request processed in 50us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844632.316353:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788844632.316366:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788844632.316372:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267890688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.326855:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788844632.326875:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267890816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844632.329683:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267890688:12345-0@lo:400:kworker.0 Request processed in 13299us (14422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844632.329709:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1788844632.329766:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788844632.329772:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788844632.329775:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844632.329859:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267891072:0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.330805:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267890816:12345-0@lo:400:kworker.0 Request processed in 3935us (15467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844632.330815:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788844632.330852:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267890560 00000100:00100000:0.0:1788844632.330860:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267890560 00000100:00100000:0.0:1788844632.330901:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788844632.330909:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267890560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.330982:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267890560:12345-0@lo:400:kworker.0 Request processed in 73us (15908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844632.330989:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788844632.331130:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267890816:0@lo:400:kworker.0 00000100:00100000:0.0:1788844632.331143:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267890688:0@lo:400:kworker.0 00000100:00100000:3.0:1788844632.331317:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed856a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267890560:0@lo:400:kworker.0 00000100:00100000:1.0:1788844632.833690:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267891328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844632.834678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844632.834770:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267891328 00000100:00100000:1.0:1788844632.834778:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267891328 00000100:00100000:1.0:1788844632.834966:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788844632.834977:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267891328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844632.835027:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844632.835085:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267891328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844632.835092:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788844632.835137:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec4ff6a00 x1875739267891328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844632.835158:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267891328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788844633.274772:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844633.338732:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267891456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844633.338809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844633.338966:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267891456 00000100:00100000:0.0:1788844633.338973:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267891456 00000100:00100000:0.0:1788844633.339031:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788844633.339040:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267891456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788844633.339075:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844633.339120:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267891456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844633.339127:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788844633.339175:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267891456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788844634.297908:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788844634.938262:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788844635.323738:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788844635.576110:0:11844:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:17:13 (1788844633) 00010000:00010000:3.0:1788844636.345833:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844637.127223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844637.127306:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244783488 00000100:00100000:3.0:1788844637.127315:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244783488 00000100:00100000:3.0:1788844637.127362:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 291 00000100:00100000:3.0:1788844637.127371:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2356:x1875739244783488:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844637.127680:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2356:x1875739244783488:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 309us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844637.127689:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 291 00000100:00100000:1.0:1788844637.131087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844637.131225:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844637.131714:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244783616 00000100:00100000:0.0:1788844637.131724:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244783616 00000100:00100000:0.0:1788844637.131786:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244783744 00000100:00100000:0.0:1788844637.131790:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244783744 00000100:00100000:0.0:1788844637.131829:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 142 00000100:00100000:0.0:1788844637.131839:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2355:x1875739244783616:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844637.131930:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2355:x1875739244783616:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 92us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844637.131938:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 142 00000100:00100000:0.0:1788844637.131964:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 143 00000100:00100000:0.0:1788844637.131972:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244783744:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844637.131996:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244783744:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 24us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844637.132002:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 143 00000100:00080000:1.0:1788844637.132412:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788844637.369788:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844637.435503:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb3dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267891712:0@lo:400:kworker.0 00000100:00100000:2.0:1788844637.435683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844637.435746:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267892224:0@lo:400:kworker.0 00000100:00100000:2.0:1788844637.435771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844637.435811:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788844637.435816:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267891840:0@lo:400:kworker.0 00000100:00100000:2.0:1788844637.435841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844637.435868:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267892224 00000100:00100000:2.0:1788844637.435875:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267892224 00000100:00100000:2.0:1788844637.435936:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788844637.435945:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267892224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844637.435989:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267892224:12345-0@lo:400:kworker.0 Request processed in 46us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844637.435996:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1788844637.436078:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb3dc000 x1875739267892224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788844653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844637.436091:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267892224:0@lo:400:kworker.0 00000100:00100000:3.0:1788844637.436223:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267891584:0@lo:400:kworker.0 00000100:00100000:3.0:1788844637.436512:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844637.436574:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267892096:0@lo:400:kworker.0 00000100:00100000:3.0:1788844637.436597:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844637.436616:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844637.436622:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267891968:0@lo:400:kworker.0 00000100:00100000:3.0:1788844637.436641:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844637.436674:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267891968 00000100:00100000:3.0:1788844637.436681:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267891968 00000100:00100000:3.0:1788844637.436710:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788844637.436718:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267891968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844637.436758:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267891968:12345-0@lo:400:kworker.0 Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844637.436764:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788844637.436787:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267891712 00000100:00100000:3.0:1788844637.436791:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267891712 00000100:00100000:3.0:1788844637.436814:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267891840 00000100:00100000:3.0:1788844637.436817:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267891840 00000100:00100000:3.0:1788844637.436829:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267892096 00000100:00100000:3.0:1788844637.436831:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267892096 00000100:00100000:3.0:1788844637.436843:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788844637.436848:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267891712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844637.436879:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267891712:12345-0@lo:400:kworker.0 Request processed in 30us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844637.436885:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788844637.436896:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788844637.436902:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267891840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844637.436939:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267891840:12345-0@lo:400:kworker.0 Request processed in 38us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844637.436945:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788844637.436956:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788844637.436962:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267892096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844637.436984:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267892096:12345-0@lo:400:kworker.0 Request processed in 22us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844637.436989:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788844637.437018:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267891968:0@lo:400:kworker.0 00000100:00100000:3.0:1788844637.437040:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267892096:0@lo:400:kworker.0 00000100:00080000:1.0:1788844637.437187:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788844637.437192:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788844637.437193:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788844637.438132:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267891584 00000100:00100000:2.0:1788844637.438140:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267891584 00000100:00100000:2.0:1788844637.438188:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788844637.438195:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267891584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844637.438259:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267891584:12345-0@lo:400:kworker.0 Request processed in 64us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844637.438267:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788844637.438314:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267891840:0@lo:400:kworker.0 00000100:00100000:2.0:1788844637.438324:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb3dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267891712:0@lo:400:kworker.0 00000100:00100000:1.0:1788844637.438410:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267891584:0@lo:400:kworker.0 00000100:00100000:3.0:1788844637.605735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844637.608469:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244783872 00000100:00100000:0.0:1788844637.608492:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244783872 00000100:00100000:0.0:1788844637.608600:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:0.0:1788844637.608610:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:10228:x1875739244783872:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788844637.608629:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844637.608690:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d94e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f92c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844637.608762:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d94f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844637.608776:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d94f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844637.608806:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d94f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844637.608845:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788844637.608849:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788844637.608889:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d94f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844637.608925:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d94e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f92c expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844637.608945:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d94f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f92c expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844637.608953:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796100) 00010000:00010000:0.0:1788844637.608956:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788844637.608959:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031600, rc 0) 00000100:00100000:0.0:1788844637.609031:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:10228:x1875739244783872:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 422us (3306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844637.609038:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:0.0:1788844637.637272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844637.637375:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244784000 00000100:00100000:2.0:1788844637.637385:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244784000 00000100:00100000:2.0:1788844637.637448:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:2.0:1788844637.637458:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:10229:x1875739244784000:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788844637.637478:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844637.637499:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d94f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f933 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.637608:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d94fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.637622:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d94fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.637631:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d94fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.637668:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.637676:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.637685:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638066:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d950c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638076:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d950c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638083:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d950c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844637.638113:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788844637.638117:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844637.638139:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d950c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638150:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d94fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638156:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d94fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638162:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d94fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638178:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844637.638183:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d94fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638191:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d94fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638204:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796100) 00010000:00010000:2.0:1788844637.638207:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844637.638212:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d94fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638218:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d94fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638232:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638238:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9505 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638243:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638248:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844637.638251:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638257:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9505 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638277:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91eec2f43b00) 00010000:00010000:2.0:1788844637.638280:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844637.638283:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9505 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638288:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9505 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638322:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d94f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f933 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638336:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d950c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f933 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844637.638342:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eec2f43600) 00010000:00010000:2.0:1788844637.638345:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844637.638347:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65c00, rc 0) 00000100:00100000:2.0:1788844637.640003:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:10229:x1875739244784000:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 2535us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844637.640016:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:1.0:1788844637.649378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844637.650920:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244784256 00000100:00100000:3.0:1788844637.650936:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244784256 00000100:00100000:3.0:1788844637.651020:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:3.0:1788844637.651031:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:10229:x1875739244784256:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844637.651049:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844637.651069:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9513 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f93a expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651148:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d951a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651163:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d951a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651175:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d951a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651238:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9521 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651247:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9521 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651264:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9521 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651669:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9528 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651680:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9528 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651695:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9528 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844637.651706:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788844637.651857:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d951a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651865:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d951a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651872:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d951a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651878:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844637.651883:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d951a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.651890:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d951a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.652036:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eec2f43600) 00010000:00010000:3.0:1788844637.652040:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844637.652045:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d951a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.652052:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d951a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.652067:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9521 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.652072:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9521 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.652086:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9521 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.652091:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844637.652094:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9521 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.652101:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9521 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.652110:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91eed38cf100) 00010000:00010000:3.0:1788844637.652113:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844637.652115:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9521 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.652121:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9521 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.653719:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9513 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f93a expref: 10 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.653742:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9528 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f93a expref: 9 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844637.653750:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:3.0:1788844637.653753:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844637.653756:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024c00, rc 0) 00000100:00100000:3.0:1788844637.653875:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:10229:x1875739244784256:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 2845us (4506us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788844637.653895:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:1.0:1788844637.669490:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844637.671454:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244784384 00000100:00100000:2.0:1788844637.671469:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244784384 00000100:00100000:2.0:1788844637.671569:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:2.0:1788844637.671580:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:10229:x1875739244784384:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788844637.671699:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:10229:x1875739244784384:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 Request processed in 119us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844637.671706:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:3.0:1788844637.947429:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267892352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844637.947558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844637.947663:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267892352 00000100:00100000:3.0:1788844637.947673:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267892352 00000100:00100000:3.0:1788844637.947734:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788844637.947746:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267892352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844637.947844:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844637.947918:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267892352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844637.947926:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788844637.947986:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eec4ff4000 x1875739267892352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844637.948008:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267892352:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788844638.018715:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788844638.394288:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844638.458648:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267892480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844638.458747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844638.458800:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267892480 00000100:00100000:3.0:1788844638.458812:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267892480 00000100:00100000:3.0:1788844638.458880:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788844638.458903:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267892480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844638.458950:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844638.459010:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267892480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844638.459019:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788844638.459385:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267892480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788844639.418106:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844640.194224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844640.194306:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244784512 00000100:00100000:3.0:1788844640.194342:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244784512 00000100:00080000:0.0:1788844640.194553:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844640.194753:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:3.0:1788844640.194768:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:10271:x1875739244784512:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844640.194794:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844640.194820:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f941 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.194929:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d953d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.194953:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d953d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.194974:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d953d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.194994:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9544 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195003:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195010:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195268:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d953d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195277:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d953d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195284:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d953d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195299:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844640.195304:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d953d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195313:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d953d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195331:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796100) 00010000:00010000:3.0:1788844640.195334:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844640.195340:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d953d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195347:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d953d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195360:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195366:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9544 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195371:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9544 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195376:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844640.195378:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9544 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195384:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9544 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195402:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91eed38cf800) 00010000:00010000:3.0:1788844640.195405:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844640.195408:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9544 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195413:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9544 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195472:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9536 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f941 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195485:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796100) 00010000:00010000:3.0:1788844640.195487:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844640.195492:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f941 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.195502:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025c00, rc 0) 00000100:00100000:3.0:1788844640.195623:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:10271:x1875739244784512:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 858us (1416us total) trans 0 rc 301/301 00000100:00100000:3.0:1788844640.195631:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:1.0:1788844640.210693:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844640.211528:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244784768 00000100:00100000:0.0:1788844640.211631:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244784768 00000100:00100000:0.0:1788844640.211703:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:0.0:1788844640.211713:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:10271:x1875739244784768:12345-192.168.204.43@tcp:36:lfs.0 00010000:00010000:0.0:1788844640.211794:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844640.211834:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d94f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f92c expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.211868:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796100) 00010000:00010000:0.0:1788844640.211880:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788844640.212134:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d954b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.212148:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d954b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.212158:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d954b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.212169:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.212176:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.212182:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844640.214735:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788844640.214759:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d954b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.214773:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d954b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.214788:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d954b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.214795:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844640.214801:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d954b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.214810:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d954b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.214832:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796600) 00010000:00010000:1.0:1788844640.214836:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844640.214841:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d954b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.214848:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d954b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788844640.214883:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c21f84f reply state 0000000004f7addd transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844640.214895:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788844640.215063:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:10271:x1875739244784768:12345-192.168.204.43@tcp:36:lfs.0 Request processed in 3344us (4375us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788844640.215074:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 37 00010000:00010000:0.0:1788844640.218912:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.218935:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.218943:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.218959:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844640.218965:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.218974:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.218994:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91eee1796e00) 00010000:00010000:0.0:1788844640.218997:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844640.219002:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.219009:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9552 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844640.297292:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844640.297340:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244784896 00000100:00100000:1.0:1788844640.297353:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244784896 00000100:00100000:1.0:1788844640.297425:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:1.0:1788844640.297437:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:10279:x1875739244784896:12345-192.168.204.43@tcp:101:lctl.0 00010000:00010000:1.0:1788844640.297481:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844640.297519:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bb800/0x7f1093851e2d9559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f948 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.297663:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba400/0x7f1093851e2d9560 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.297683:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba400/0x7f1093851e2d9560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.297697:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba400/0x7f1093851e2d9560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844640.297749:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788844640.297755:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844640.297800:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba400/0x7f1093851e2d9560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.297832:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bb800/0x7f1093851e2d9559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f948 expref: 11 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.297866:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba400/0x7f1093851e2d9560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f948 expref: 10 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.297875:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:1.0:1788844640.297879:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788844640.297883:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99ba400, rc 0) 00000100:00100000:1.0:1788844640.297965:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:10279:x1875739244784896:12345-192.168.204.43@tcp:101:lctl.0 Request processed in 529us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844640.297972:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:1.0:1788844640.364943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844640.365075:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244785024 00000100:00100000:3.0:1788844640.365088:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244785024 00000100:00100000:3.0:1788844640.365197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:3.0:1788844640.365208:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:10285:x1875739244785024:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844640.365244:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844640.365271:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f94f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365484:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d956e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365503:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d956e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365516:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d956e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365534:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9575 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365656:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365666:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365797:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d957c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365806:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d957c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365813:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d957c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844640.365861:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788844640.365865:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844640.365910:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d957c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365937:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d956e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365943:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d956e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365950:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d956e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365956:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844640.365961:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d956e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365969:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d956e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365983:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:3.0:1788844640.365985:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844640.365991:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d956e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.365998:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d956e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.366007:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.366012:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9575 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.366017:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.366028:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844640.366031:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.366037:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9575 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.366044:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91eed38cf100) 00010000:00010000:3.0:1788844640.366047:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844640.366050:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9575 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.366055:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9575 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.366090:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f94f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.366103:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d957c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f94f expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.366111:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844640.366113:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788844640.366115:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025e00, rc 0) 00000100:00100000:3.0:1788844640.366200:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+11:10285:x1875739244785024:12345-192.168.204.43@tcp:101:bash.0 Request processed in 992us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844640.366208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:0.0:1788844640.372330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844640.372939:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244785280 00000100:00100000:1.0:1788844640.372958:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244785280 00000100:00100000:1.0:1788844640.373085:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:1.0:1788844640.373098:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+11:10285:x1875739244785280:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1788844640.373129:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844640.373157:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bb800/0x7f1093851e2d9583 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f956 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.373361:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bac00/0x7f1093851e2d958a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.373380:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bac00/0x7f1093851e2d958a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.373395:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bac00/0x7f1093851e2d958a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.373768:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.373797:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.373810:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788844640.374781:0:8217:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788844640.374984:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.374996:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.375013:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.375055:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bac00/0x7f1093851e2d958a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.375062:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bac00/0x7f1093851e2d958a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.375068:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bac00/0x7f1093851e2d958a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.375074:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed99bac00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844640.375078:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bac00/0x7f1093851e2d958a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.375086:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bac00/0x7f1093851e2d958a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.375099:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:1.0:1788844640.375102:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844640.375107:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bac00/0x7f1093851e2d958a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.375113:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bac00/0x7f1093851e2d958a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788844640.375126:0:8217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bf22c37 reply state 00000000e80c9dbf transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844640.375135:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788844640.375182:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99bb800/0x7f1093851e2d9583 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f956 expref: 14 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.375199:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f956 expref: 13 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.375207:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eec7351700) 00010000:00010000:1.0:1788844640.375209:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844640.375211:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed99ba800, rc 0) 00000100:00100000:1.0:1788844640.375293:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10285:x1875739244785280:12345-192.168.204.43@tcp:101:bash.0 Request processed in 2198us (2980us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788844640.375302:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:2.0:1788844640.382210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844640.382359:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244785408 00000100:00100000:3.0:1788844640.382393:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244785408 00000100:00100000:3.0:1788844640.382501:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:3.0:1788844640.382511:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1875739244785408:12345-192.168.204.43@tcp:8:bash.0 00010000:00080000:3.0:1788844640.382583:0:7066:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:3.0:1788844640.382623:0:7066:0:(genops.c:1385:class_connect()) connect: client 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1, cookie 0x7f1093851e2d95a6 00002000:00100000:3.0:1788844640.382637:0:7066:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1/ffff91eed2c32800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788844640.382669:0:7066:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788844640.382980:0:7066:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788844640.383021:0:7066:0:(import.c:65:import_set_state_nolock()) ffff91eed2c32000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788844640.383116:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2353:x1875739244785408:12345-192.168.204.43@tcp:8:bash.0 Request processed in 604us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844640.383125:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00010000:00010000:0.0:1788844640.384751:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.384771:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.384780:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.384786:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed99ba000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844640.384792:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.384801:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.384846:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eec7351600) 00010000:00010000:0.0:1788844640.384861:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844640.384866:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.384874:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba000/0x7f1093851e2d9591 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844640.386619:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844640.386672:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244785536 00000100:00100000:0.0:1788844640.386685:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244785536 00000100:00100000:0.0:1788844640.386774:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1788844640.386787:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:0:x1875739244785536:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1788844640.386811:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844640.386842:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f978029/0x7f1093851e2d95ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f95d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788844640.386887:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788844640.386913:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1788844640.386919:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844640.386931:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f978029/0x7f1093851e2d95ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f95d expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.386953:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f978029/0x7f1093851e2d95ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f95d expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.386969:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031600, rc 0) 00000100:00100000:0.0:1788844640.387098:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:0:x1875739244785536:12345-192.168.204.43@tcp:101:bash.0 Request processed in 313us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844640.387135:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00080000:1.0:1788844640.387754:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788844640.391074:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844640.391168:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244785664 00000100:00100000:3.0:1788844640.391186:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244785664 00000100:00100000:3.0:1788844640.391273:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:3.0:1788844640.391286:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:10285:x1875739244785664:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844640.391308:0:7066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844640.391335:0:7066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f964 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.391774:0:7066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f978029/0x7f1093851e2d95ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f95d expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.391785:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844640.391790:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844640.391809:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.391874:0:7066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f978029/0x7f1093851e2d95ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f95d expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.391893:0:7066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f978029/0x7f1093851e2d95ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f95d expref: 8 pid: 6688 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844640.391911:0:7066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7066:1875739267892608:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844640.392105:0:7066:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67000 going to sleep for 11 seconds 00000100:00100000:2.0:1788844640.396102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844640.396205:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244785792 00000100:00100000:0.0:1788844640.396218:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244785792 00010000:00010000:0.0:1788844640.396285:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f978029/0x7f1093851e2d95ad lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f95d expref: 9 pid: 6688 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844640.396343:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:0.0:1788844640.396355:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2355:x1875739244785792:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844640.396376:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844640.396406:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f978029/0x7f1093851e2d95ad lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f95d expref: 9 pid: 6688 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.396433:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f978029/0x7f1093851e2d95ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f95d expref: 9 pid: 6688 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.396484:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844640.396489:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844640.396499:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 9 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.396510:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 9 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844640.396605:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 9 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844640.396649:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb3dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875739267892736:192.168.204.43@tcp:105: 00010000:00010000:3.0:1788844640.396735:0:7066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f978029/0x7f1093851e2d95ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f95d expref: 9 pid: 6688 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844640.396765:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844640.396766:0:7066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7066:1875739267892608:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844640.396810:0:7066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.396827:0:7066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025c00, rc 0) 00000100:00100000:3.0:1788844640.396898:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:10285:x1875739244785664:12345-192.168.204.43@tcp:101:bash.0 Request processed in 5614us (5832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844640.396907:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:0.0:1788844640.406987:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844640.407096:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244786048 00000100:00100000:2.0:1788844640.407113:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244786048 00000100:00100000:2.0:1788844640.407345:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:2.0:1788844640.407359:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:10285:x1875739244786048:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:3.0:1788844640.407386:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb3dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875739267892736:192.168.204.43@tcp:105: 00010000:00010000:3.0:1788844640.407487:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844640.407794:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244785792:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 11439us (11708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844640.407830:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:2.0:1788844640.407886:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10285:x1875739244786048:12345-192.168.204.43@tcp:35:bash.0 Request processed in 530us (909us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788844640.407894:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00010000:00010000:3.0:1788844640.443376:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844640.516476:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844640.516735:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244786304 00000100:00100000:1.0:1788844640.516750:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244786304 00000100:00100000:1.0:1788844640.516833:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:1.0:1788844640.516856:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10295:x1875739244786304:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844640.516892:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844640.516921:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2d95bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f96b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844640.517047:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788844640.517226:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2d95bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f96b expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.517245:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:1.0:1788844640.517248:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788844640.517272:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2d95bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f96b expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.517291:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61200, rc 0) 00000100:00100000:1.0:1788844640.517381:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:10295:x1875739244786304:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 537us (922us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788844640.517389:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:0.0:1788844640.521986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844640.522075:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244786560 00000100:00100000:1.0:1788844640.522088:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244786560 00000100:00100000:1.0:1788844640.522161:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:1.0:1788844640.522175:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:10295:x1875739244786560:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844640.522518:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:10295:x1875739244786560:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 345us (547us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788844640.522527:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:0.0:1788844640.601661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844640.602131:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244786688 00000100:00100000:3.0:1788844640.602145:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244786688 00000100:00100000:3.0:1788844640.602333:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:3.0:1788844640.602469:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:10301:x1875739244786688:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844640.602502:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844640.602531:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d95c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f972 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.602752:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d95d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.602770:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d95d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.602784:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d95d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844640.602831:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788844640.602836:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844640.602875:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d95d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.602907:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d95c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f972 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.602930:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d95d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f972 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.602962:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844640.602966:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788844640.602970:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844640.603046:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:10301:x1875739244786688:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 581us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844640.603053:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:0.0:1788844640.607141:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844640.607241:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244786944 00000100:00100000:1.0:1788844640.607256:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244786944 00000100:00100000:1.0:1788844640.607329:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:1.0:1788844640.607465:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:10301:x1875739244786944:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844640.607495:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844640.607522:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2d95d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f979 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.608104:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d95de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.608124:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d95de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.608162:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d95de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844640.608177:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788844640.608757:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2d95d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f979 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.608783:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d95de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f979 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.608794:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eec7351700) 00010000:00010000:1.0:1788844640.608797:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844640.608802:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61800, rc 0) 00000100:00100000:1.0:1788844640.608960:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:10301:x1875739244786944:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1612us (1835us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788844640.608970:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:0.0:1788844640.620326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844640.620392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844640.620596:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244787328 00000100:00100000:2.0:1788844640.620610:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244787328 00000100:00100000:2.0:1788844640.620700:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:2.0:1788844640.620713:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2354:x1875739244787328:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844640.620735:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844640.620772:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d95de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f979 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.620799:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eec7351700) 00010000:00010000:2.0:1788844640.620806:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844640.620888:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:2354:x1875739244787328:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 178us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844640.620897:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:1.0:1788844640.622305:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244787200 00000100:00100000:1.0:1788844640.622323:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244787200 00000100:00100000:1.0:1788844640.622403:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:1.0:1788844640.622414:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:10301:x1875739244787200:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844640.622446:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844640.622474:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d95ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f980 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.623089:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d95f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.623134:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d95f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.623148:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d95f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844640.623164:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788844640.623388:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d95ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f980 expref: 21 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.623412:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d95f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f980 expref: 20 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.623422:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eec7351700) 00010000:00010000:1.0:1788844640.623426:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788844640.623430:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61c00, rc 0) 00000100:00100000:1.0:1788844640.623507:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:10301:x1875739244787200:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1094us (3197us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788844640.623515:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:0.0:1788844640.628828:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844640.628935:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244787456 00000100:00100000:2.0:1788844640.628951:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244787456 00000100:00100000:2.0:1788844640.629039:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:2.0:1788844640.629066:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244787456:12345-192.168.204.43@tcp:1:lfs.0 00010000:00010000:2.0:1788844640.629136:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.629166:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.629177:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844640.629182:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788844640.629188:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.629254:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.629272:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 7 pid: 7066 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844640.629291:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01622300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875739267892864:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844640.629429:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844640.631921:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01622300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875739267892864:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844640.632086:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844640.636804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844640.637035:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244787584 00000100:00100000:1.0:1788844640.637052:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244787584 00002000:00100000:1.0:1788844640.637116:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff91eefb3dc700 x1875739244787584/t0(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:501/0 lens 504/0 e 0 to 0 dl 1788844651 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788844640.637130:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eefb3dc700 with x1875739244787584 ext(0->12) 00010000:00010000:1.0:1788844640.637141:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 8 pid: 7066 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.637184:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 8 pid: 7066 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788844640.637194:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eefb3dc700 00000100:00100000:1.0:1788844640.637247:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:1.0:1788844640.637259:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2355:x1875739244787584:12345-192.168.204.43@tcp:4:lfs.0 00000001:00100000:2.0:1788844640.682201:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000100:00100000:1.0:1788844640.682981:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2355:x1875739244787584:12345-192.168.204.43@tcp:4:lfs.0 Request processed in 45717us (46183us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788844640.682994:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00002000:00100000:1.0:1788844640.683008:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff91eefb3dc700 x1875739244787584/t4294967299(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:501/0 lens 504/448 e 0 to 0 dl 1788844651 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788844640.683019:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eefb3dc700 with x1875739244787584 ext(0->12) 00010000:00010000:1.0:1788844640.683028:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 9 pid: 7066 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.683047:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 9 pid: 7066 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788844640.683055:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eefb3dc700 00000100:00100000:2.0:1788844640.690995:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844640.691090:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244787712 00000100:00100000:3.0:1788844640.691101:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244787712 00010000:00010000:3.0:1788844640.691142:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 9 pid: 7066 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844640.691184:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:3.0:1788844640.691194:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2354:x1875739244787712:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844640.691325:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788844640.691358:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788844640.691362:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788844639 00002000:00010000:3.0:1788844640.691364:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788844640 00002000:00010000:3.0:1788844640.691366:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788844639 00010000:00010000:3.0:1788844640.691372:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 9 pid: 7066 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.691387:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 9 pid: 7066 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.691414:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c419a93a/0x7f1093851e2d95b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f964 expref: 9 pid: 7066 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.691437:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844640.691441:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844640.691448:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.691458:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.691493:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788844640.691768:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.691788:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.691813:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.691821:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.691829:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.691836:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844640.691840:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.691860:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.691875:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.691883:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c1e2691/0x7f1093851e2d9601 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844640.691974:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244787712:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 781us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844640.691982:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:2.0:1788844640.692305:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244787456:12345-192.168.204.43@tcp:1:lfs.0 Request processed in 63240us (63492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844640.692315:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:2.0:1788844640.696224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844640.696363:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244787968 00000100:00100000:3.0:1788844640.696373:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244787968 00000100:00100000:3.0:1788844640.696433:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:3.0:1788844640.696444:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:10301:x1875739244787968:12345-192.168.204.43@tcp:35:lfs.0 00000004:00010000:3.0:1788844640.696505:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d95f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f980 expref: 20 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788844640.696827:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788844640.696897:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788844640.698147:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788844640.698479:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.698501:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f956 expref: 24 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.698522:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.698930:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f956 expref: 24 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.698947:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f956 expref: 24 pid: 8217 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844640.698964:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1875739267892992:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844640.699112:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67600 going to sleep for 11 seconds 00000100:00100000:2.0:1788844640.706015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844640.706355:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244788096 00000100:00100000:1.0:1788844640.706366:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244788096 00010000:00010000:1.0:1788844640.706408:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f956 expref: 25 pid: 8217 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844640.706464:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:1.0:1788844640.706474:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:2354:x1875739244788096:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844640.706489:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844640.706495:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f956 expref: 25 pid: 8217 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.706507:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f956 expref: 25 pid: 8217 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.706531:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eec7351700) 00010000:00010000:1.0:1788844640.706757:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.706769:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.706776:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.706796:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844640.706901:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:2354:x1875739244788096:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 427us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844640.706910:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 37 00010000:00010000:3.0:1788844640.707090:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba800/0x7f1093851e2d9598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f956 expref: 24 pid: 8217 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844640.707105:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1875739267892992:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844640.707126:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.707134:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.707139:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788844640.707271:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788844640.707485:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788844640.707648:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267893120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788844640.707702:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844640.707727:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67300 going to sleep for 11 seconds 00000100:00100000:2.0:1788844640.708041:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267893120 00000100:00100000:2.0:1788844640.708048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267893120 00000100:00100000:2.0:1788844640.708103:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788844640.708112:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875739267893120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788844640.708184:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875739267893120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 73us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844640.708191:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788844640.708229:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec4ff6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267893120:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788844640.708885:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788844640.708954:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3fcb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267893248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788844640.708991:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844640.709013:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844640.709038:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267893248 00000100:00100000:2.0:1788844640.709043:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267893248 00000100:00100000:2.0:1788844640.709070:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788844640.709077:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875739267893248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788844640.709218:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875739267893248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (226us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788844640.709224:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788844640.709271:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3fcb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267893248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788844640.709317:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788844640.709351:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.709359:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.709367:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.709374:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844640.709379:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.709387:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.709403:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eec7351700) 00010000:00010000:2.0:1788844640.709406:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788844640.709411:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.709418:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9608 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788844640.709602:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788844640.709808:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788844640.709819:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354988282116ns, next at 355988279889ns, rc = 0 00000001:00080000:2.0:1788844640.709827:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788844640.709874:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eec7351700) 00010000:00010000:2.0:1788844640.709885:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788844640.709892:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d95f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f980 expref: 28 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844640.709981:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:10301:x1875739244787968:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 13538us (13777us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788844640.709989:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000020:00080000:2.0:1788844640.709993:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788844640.710360:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788844640.713418:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844640.713532:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244788224 00000100:00100000:3.0:1788844640.713580:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244788224 00000100:00100000:3.0:1788844640.713635:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:3.0:1788844640.713644:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:10301:x1875739244788224:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844640.713667:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844640.713690:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d960f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f987 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.713766:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d960f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f987 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.713780:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d960f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f987 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.713802:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844640.713805:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788844640.713808:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025c00, rc 0) 00000100:00100000:3.0:1788844640.713879:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+28:10301:x1875739244788224:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 235us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844640.713886:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:2.0:1788844640.717740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844640.718187:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244788480 00000100:00100000:0.0:1788844640.718197:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244788480 00000100:00100000:0.0:1788844640.718262:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:0.0:1788844640.718271:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+28:10301:x1875739244788480:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1788844640.718530:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10301:x1875739244788480:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 259us (801us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788844640.719418:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:2.0:1788844640.860330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844640.864196:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244788736 00000100:00100000:3.0:1788844640.864215:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244788736 00000100:00100000:3.0:1788844640.864491:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:3.0:1788844640.864502:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10311:x1875739244788736:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844640.864620:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844640.864643:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f98e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844640.865203:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788844640.865588:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9616 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f98e expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.865603:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:3.0:1788844640.865607:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844640.865611:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f98e expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.865625:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024200, rc 0) 00000100:00100000:3.0:1788844640.865748:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:10311:x1875739244788736:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1248us (5428us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788844640.865756:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:1.0:1788844640.874405:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844640.874783:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244788864 00000100:00100000:3.0:1788844640.874794:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244788864 00000100:00100000:3.0:1788844640.874870:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:3.0:1788844640.874882:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:10311:x1875739244788864:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:3.0:1788844640.874979:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9624 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.874996:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9624 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875011:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9624 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875043:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d962b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875050:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d962b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875057:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d962b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875143:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875152:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875159:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788844640.875201:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875213:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9624 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875219:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9624 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875226:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9624 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875232:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844640.875236:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9624 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875250:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9624 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875276:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844640.875279:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844640.875284:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9624 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875290:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9624 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875303:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d962b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875309:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d962b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875315:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d962b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875320:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844640.875323:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d962b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875580:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d962b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875591:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eed38cf900) 00010000:00010000:3.0:1788844640.875593:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844640.875596:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d962b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875611:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d962b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875627:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875632:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875638:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875642:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844640.875645:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875650:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875658:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844640.875660:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844640.875662:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844640.875667:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9632 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844640.875736:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:10311:x1875739244788864:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 856us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844640.875745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:2.0:1788844640.887328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844640.887660:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244789120 00000100:00100000:0.0:1788844640.887671:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244789120 00000100:00100000:0.0:1788844640.887734:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:0.0:1788844640.887745:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:10311:x1875739244789120:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1788844640.888101:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10311:x1875739244789120:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 356us (781us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788844640.888109:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:0.0:1788844640.946971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844640.947576:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244789376 00000100:00100000:1.0:1788844640.947586:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244789376 00000100:00100000:1.0:1788844640.947657:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:1.0:1788844640.947666:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10314:x1875739244789376:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844640.947691:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844640.947711:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9639 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f995 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.947790:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9640 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.947804:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9640 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.947814:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9640 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948057:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9647 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948065:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948073:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948189:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948197:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948215:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844640.948236:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788844640.948450:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9640 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948458:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9640 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948465:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9640 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948470:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844640.948474:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9640 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948481:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9640 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948493:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:1.0:1788844640.948496:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844640.948500:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9640 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948506:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9640 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948520:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948525:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9647 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948638:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9647 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948644:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844640.948647:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9647 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948653:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9647 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948661:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eec7351a00) 00010000:00010000:1.0:1788844640.948663:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844640.948666:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9647 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948672:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9647 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948713:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9639 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f995 expref: 34 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948725:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f995 expref: 33 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844640.948732:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:1.0:1788844640.948734:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844640.948736:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61a00, rc 0) 00000100:00100000:1.0:1788844640.948864:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10314:x1875739244789376:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1198us (1912us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788844640.948880:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:1.0:1788844640.954266:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844640.954950:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244789504 00000100:00100000:2.0:1788844640.954971:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244789504 00000100:00100000:2.0:1788844640.955039:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:2.0:1788844640.955051:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10314:x1875739244789504:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:2.0:1788844640.955124:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d965c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.955140:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d965c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.955150:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d965c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.955175:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d965c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.955182:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d965c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.955188:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d965c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.955219:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844640.955224:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d965c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.955232:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d965c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.955244:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:2.0:1788844640.955248:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788844640.955253:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d965c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844640.955704:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d965c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844640.956644:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10314:x1875739244789504:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 1587us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844640.956655:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:2.0:1788844640.965891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844640.966573:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244789760 00000100:00100000:0.0:1788844640.966584:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244789760 00000100:00100000:0.0:1788844640.966639:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1788844640.966649:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10314:x1875739244789760:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1788844640.967575:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:10314:x1875739244789760:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 888us (1657us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788844640.967585:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000001:00080000:1.0:1788844641.108931:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:1.0:1788844641.108990:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788844641.109013:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eed1dbb480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788844641.109018:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eeff69dd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eed1dbb600 00000020:00080000:1.0:1788844641.109021:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eeff69d400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91ef0141b000 00000100:00100000:1.0:1788844641.109370:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267893376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788844641.109460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844641.109731:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267893376 00000100:00100000:0.0:1788844641.109752:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267893376 00000100:00100000:0.0:1788844641.109809:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788844641.109819:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875739267893376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788844641.109855:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788844641.109895:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f9a5f, atime: 0x6a9f9a60, ctime: 0x6a9f9a5f, blocks: 0x1 00010000:00010000:0.0:1788844641.109904:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c7040a/0x7f1093851e2d9663 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.109922:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1788844641.109927:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844641.109933:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087c7040a/0x7f1093851e2d9663 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.109949:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087c7040a/0x7f1093851e2d9663 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.109959:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087c7040a/0x7f1093851e2d9663 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.109986:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087c7040a/0x7f1093851e2d9663 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.110001:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1788844641.111035:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788844641.111123:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1788844641.111135:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844641.111144:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087c7040a/0x7f1093851e2d9663 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.111157:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031c00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844641.111162:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c7040a/0x7f1093851e2d9663 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.111412:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087c7040a/0x7f1093851e2d9663 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.111511:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087c7040a/0x7f1093851e2d9663 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.111520:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087c7040a/0x7f1093851e2d9663 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.111570:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844641.111573:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844641.111575:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844641.111660:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1875739267893376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1838us (2196us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788844641.111670:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1788844641.112481:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eefb3de680/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788844641.112492:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267893376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788844641.379911:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844641.379997:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244790016 00000100:00100000:3.0:1788844641.380009:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244790016 00000100:00100000:3.0:1788844641.380069:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:3.0:1788844641.380079:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:10345:x1875739244790016:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:3.0:1788844641.380104:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844641.380126:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d966a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f99c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.380231:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.380247:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.380258:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844641.380271:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788844641.380506:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d966a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f99c expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.380523:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f99c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.380531:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844641.380534:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844641.380582:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024e00, rc 0) 00000100:00100000:3.0:1788844641.380642:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10345:x1875739244790016:12345-192.168.204.43@tcp:101:cat.0 Request processed in 564us (741us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788844641.380661:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:1.0:1788844641.386270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844641.387273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844641.387481:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244790400 00000100:00100000:3.0:1788844641.387496:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244790400 00000100:00100000:3.0:1788844641.387593:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:3.0:1788844641.387604:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:2357:x1875739244790400:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844641.387622:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844641.387649:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f99c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.387671:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844641.387676:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844641.387795:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2357:x1875739244790400:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 191us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844641.387803:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:2.0:1788844641.390909:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244790272 00000100:00100000:2.0:1788844641.390927:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244790272 00000100:00100000:2.0:1788844641.391055:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:2.0:1788844641.391066:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:10345:x1875739244790272:12345-192.168.204.43@tcp:35:cat.0 00000100:00100000:2.0:1788844641.391400:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10345:x1875739244790272:12345-192.168.204.43@tcp:35:cat.0 Request processed in 335us (5142us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788844641.391408:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00010000:00010000:3.0:1788844641.467591:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844641.483518:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844641.483713:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244790656 00000100:00100000:3.0:1788844641.483724:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244790656 00000100:00100000:3.0:1788844641.483792:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:3.0:1788844641.483805:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10351:x1875739244790656:12345-192.168.204.43@tcp:101:dd.0 00010000:00010000:3.0:1788844641.483842:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844641.483846:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788844641.483881:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d95d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f972 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.483905:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844641.483911:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844641.483943:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d967f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.484070:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.484085:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f995 expref: 14 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.484094:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.484131:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f995 expref: 14 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.484146:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f995 expref: 14 pid: 8217 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844641.484162:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e22d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267893504:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844641.484263:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788844641.489936:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e22d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267893504:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844641.489973:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844641.493145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844641.493249:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244790784 00000100:00100000:2.0:1788844641.493260:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244790784 00010000:00010000:2.0:1788844641.493302:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f995 expref: 15 pid: 8217 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844641.493371:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:2.0:1788844641.493380:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:2355:x1875739244790784:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844641.493396:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844641.493403:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f995 expref: 15 pid: 8217 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.493417:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f995 expref: 15 pid: 8217 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.493444:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d964e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f995 expref: 15 pid: 8217 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.493462:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:2.0:1788844641.493468:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.493478:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.493486:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844641.493529:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844641.493633:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:2355:x1875739244790784:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 253us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844641.493642:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00010000:00010000:0.0:1788844641.493743:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.493753:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844641.493774:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788844641.493954:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d967f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9a3 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.493971:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9a3 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.493979:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:0.0:1788844641.493982:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788844641.493985:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:0.0:1788844641.494013:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10351:x1875739244790656:12345-192.168.204.43@tcp:101:dd.0 Request processed in 10211us (10510us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788844641.494020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:0.0:1788844641.506797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844641.506925:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244791040 00000100:00100000:3.0:1788844641.506936:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244791040 00000100:00100000:3.0:1788844641.507005:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:3.0:1788844641.507015:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10351:x1875739244791040:12345-192.168.204.43@tcp:36:dd.0 00010000:00010000:3.0:1788844641.507301:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.507327:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844641.507340:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788844641.507424:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788844641.507452:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043f315be reply state 000000006fddb39f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844641.507462:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788844641.507603:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:10351:x1875739244791040:12345-192.168.204.43@tcp:36:dd.0 Request processed in 589us (818us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788844641.507611:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 52 00000020:00080000:3.0:1788844641.507616:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788844641.522526:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.522558:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.522566:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.522571:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844641.522576:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.522584:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.522602:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:0.0:1788844641.522605:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844641.522610:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844641.522616:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9694 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844642.002234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844642.003235:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244791168 00000100:00100000:2.0:1788844642.003403:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244791168 00000100:00100000:2.0:1788844642.003533:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:2.0:1788844642.003592:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:10366:x1875739244791168:12345-192.168.204.43@tcp:101:stat.0 00010000:00010000:2.0:1788844642.003618:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844642.003642:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d969b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.003722:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d96a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.003737:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d96a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.003749:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d96a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.003764:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d96a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.003770:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d96a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.003776:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d96a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.004523:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788844642.004824:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788844642.005064:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9a3 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.005075:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.005182:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9a3 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.005199:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9a3 expref: 17 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844642.005213:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3fcbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267893632:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844642.005385:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed2c6fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788844642.019393:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3fcbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267893632:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844642.019431:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844642.025877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844642.026058:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244791424 00000100:00100000:2.0:1788844642.026067:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244791424 00000100:00100000:2.0:1788844642.026124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:2.0:1788844642.026134:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:5596:x1875739244791424:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788844642.026473:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:5596:x1875739244791424:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 338us (607us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788844642.026481:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1788844642.031146:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844642.031288:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244791552 00000100:00100000:2.0:1788844642.031299:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244791552 00010000:00010000:2.0:1788844642.031342:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9a3 expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844642.031390:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:2.0:1788844642.031402:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2354:x1875739244791552:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844642.031427:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844642.031434:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9a3 expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.031448:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9a3 expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.031472:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9686 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9a3 expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.031488:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:2.0:1788844642.031493:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.031502:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.031510:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.031878:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.031887:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844642.031931:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788844642.031947:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844642.031992:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032004:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032021:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d96a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032031:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d96a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032037:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d96a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032043:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844642.032047:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d96a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032055:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d96a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032066:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:1.0:1788844642.032069:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844642.032074:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d96a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032080:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d96a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032091:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d96a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032097:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d96a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032102:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d96a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032113:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844642.032116:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d96a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032123:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d96a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032130:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eec2f43b00) 00010000:00010000:1.0:1788844642.032133:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844642.032135:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d96a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032140:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d96a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032180:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d969b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9aa expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032193:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9aa expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.032199:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:1.0:1788844642.032201:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844642.032203:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65e00, rc 0) 00000100:00100000:1.0:1788844642.032271:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:10366:x1875739244791168:12345-192.168.204.43@tcp:101:stat.0 Request processed in 28681us (30048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844642.032278:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00010000:00010000:2.0:1788844642.032708:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844642.032733:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:2354:x1875739244791552:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1333us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844642.032742:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:1.0:1788844642.194947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844642.196184:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244791808 00000100:00100000:3.0:1788844642.196200:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244791808 00000100:00100000:3.0:1788844642.196274:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:3.0:1788844642.196285:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:10372:x1875739244791808:12345-192.168.204.43@tcp:36:truncate.0 00010000:00010000:3.0:1788844642.196358:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844642.196391:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d96b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9aa expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.196413:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844642.196419:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844642.196708:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.196738:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.196750:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788844642.196807:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788844642.196847:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000632c1251 reply state 0000000041a5243c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844642.196857:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788844642.197009:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:10372:x1875739244791808:12345-192.168.204.43@tcp:36:truncate.0 Request processed in 724us (2071us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788844642.197017:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 54 00000020:00080000:3.0:1788844642.197022:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788844642.202609:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.202628:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.202635:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.202642:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844642.202647:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.202655:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.202703:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844642.202706:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844642.202711:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.202717:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844642.241973:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844642.242015:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844642.242065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844642.242240:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244791936 00000100:00100000:2.0:1788844642.242240:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244792064 00000100:00100000:3.0:1788844642.242251:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244791936 00000100:00100000:2.0:1788844642.242251:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244792064 00000100:00100000:3.0:1788844642.242327:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 293 00000100:00100000:2.0:1788844642.242327:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:3.0:1788844642.242345:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244791936:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844642.242346:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244792064:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:1.0:1788844642.242437:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788844642.242471:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244792192 00000100:00100000:1.0:1788844642.242476:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244792192 00000100:00100000:1.0:1788844642.242510:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 147 00000100:00100000:1.0:1788844642.242518:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244792192:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:0.0:1788844642.242586:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844642.242826:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244792064:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 474us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844642.242836:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:3.0:1788844642.253566:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244791936:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 11195us (11569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844642.253582:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 293 00000100:00100000:1.0:1788844642.261012:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244792192:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 18476us (18978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844642.261028:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 147 00010000:00010000:2.0:1788844642.490071:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844642.499637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844642.499844:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244792320 00000100:00100000:3.0:1788844642.499856:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244792320 00000100:00100000:3.0:1788844642.500079:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:3.0:1788844642.500091:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:10386:x1875739244792320:12345-192.168.204.43@tcp:101:stat.0 00010000:00010000:3.0:1788844642.500116:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844642.500138:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9b1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500203:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d96c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500219:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d96c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500250:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d96c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500268:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d96cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500277:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d96cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500283:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d96cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500678:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500688:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500696:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844642.500737:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788844642.500742:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844642.500767:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500779:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500788:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d96c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500804:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d96c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500822:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d96c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500829:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844642.500833:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d96c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500841:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d96c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500854:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844642.500857:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844642.500861:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d96c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500868:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d96c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500883:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d96cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500890:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d96cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500895:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d96cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500901:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844642.500912:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d96cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500919:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d96cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500927:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eed38cf900) 00010000:00010000:3.0:1788844642.500930:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844642.500933:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d96cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500939:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d96cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500975:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d96be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b1 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500990:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b1 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.500998:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844642.501000:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844642.501003:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844642.501064:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:10386:x1875739244792320:12345-192.168.204.43@tcp:101:stat.0 Request processed in 976us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844642.501072:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:0.0:1788844642.554056:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267893888:0@lo:400:kworker.0 00000100:00100000:0.0:1788844642.554129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844642.554196:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267894400:0@lo:400:kworker.0 00000100:00100000:0.0:1788844642.554235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844642.554265:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788844642.554271:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267893760:0@lo:400:kworker.0 00000100:00100000:0.0:1788844642.554308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844642.554332:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267894272:0@lo:400:kworker.0 00000100:00100000:0.0:1788844642.554355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844642.554384:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267893760 00000100:00100000:0.0:1788844642.554392:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267893760 00000100:00100000:0.0:1788844642.554435:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788844642.554443:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267893760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844642.554492:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267893760:12345-0@lo:400:kworker.0 Request processed in 49us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844642.554500:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788844642.554572:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267893760:0@lo:400:kworker.0 00000100:00100000:3.0:1788844642.554710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267893888 00000100:00100000:3.0:1788844642.554716:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267893888 00000100:00100000:3.0:1788844642.554751:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267894272 00000100:00100000:3.0:1788844642.554754:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267894272 00000100:00100000:3.0:1788844642.554792:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788844642.554799:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267893888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844642.554848:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267893888:12345-0@lo:400:kworker.0 Request processed in 49us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844642.554854:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788844642.554867:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788844642.554874:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267894272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844642.554898:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267894272:12345-0@lo:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844642.554904:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788844642.554994:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267894144:0@lo:400:kworker.0 00000100:00100000:2.0:1788844642.555027:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844642.555059:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788844642.555065:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267894016:0@lo:400:kworker.0 00000100:00100000:2.0:1788844642.555086:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844642.555110:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267894016 00000100:00100000:2.0:1788844642.555113:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267894016 00000100:00100000:2.0:1788844642.555138:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788844642.555143:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267894016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844642.555173:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267894016:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844642.555179:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788844642.555206:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267894016:0@lo:400:kworker.0 00000100:00100000:3.0:1788844642.555270:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267894400 00000100:00100000:3.0:1788844642.555275:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267894400 00000100:00100000:3.0:1788844642.555312:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267894144 00000100:00100000:3.0:1788844642.555315:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267894144 00000100:00100000:3.0:1788844642.555333:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788844642.555339:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875739267894400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844642.555370:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875739267894400:12345-0@lo:400:kworker.0 Request processed in 31us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844642.555376:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788844642.555388:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788844642.555393:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267894144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844642.555425:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267894144:12345-0@lo:400:kworker.0 Request processed in 32us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844642.555430:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788844642.555454:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267894144:0@lo:400:kworker.0 00000100:00080000:0.0:1788844642.555846:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844642.555851:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844642.555853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844642.555893:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267894272:0@lo:400:kworker.0 00000100:00100000:0.0:1788844642.555905:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267893888:0@lo:400:kworker.0 00000100:00100000:0.0:1788844642.555915:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267894400:0@lo:400:kworker.0 00000100:00100000:0.0:1788844642.582213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844642.586186:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244792576 00000100:00100000:2.0:1788844642.586201:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244792576 00000100:00100000:2.0:1788844642.586285:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:2.0:1788844642.586296:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:10396:x1875739244792576:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844642.586318:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844642.586343:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d96da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9b8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844642.586438:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788844642.586623:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d96da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b8 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.586639:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:2.0:1788844642.586642:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788844642.586647:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d96da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b8 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.586663:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64c00, rc 0) 00000100:00100000:2.0:1788844642.586722:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:10396:x1875739244792576:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 428us (4532us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788844642.586729:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:0.0:1788844642.595404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844642.595511:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244792832 00000100:00100000:2.0:1788844642.595522:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244792832 00000100:00100000:2.0:1788844642.595614:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:2.0:1788844642.595625:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:10396:x1875739244792832:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:2.0:1788844642.595980:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:10396:x1875739244792832:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 246us (475us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788844642.595990:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:0.0:1788844642.714698:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844642.715258:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244793088 00000100:00100000:1.0:1788844642.715275:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244793088 00000100:00100000:1.0:1788844642.715353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:1.0:1788844642.715364:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:10402:x1875739244793088:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1788844642.715390:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844642.715413:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d96e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.715534:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.715586:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b1 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.715596:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.715635:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b1 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.715679:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b1 expref: 22 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844642.715694:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec31fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267894528:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844642.715820:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788844642.718426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844642.718760:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244793216 00000100:00100000:3.0:1788844642.718793:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244793216 00010000:00010000:3.0:1788844642.718858:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b1 expref: 23 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844642.718906:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:3.0:1788844642.718918:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:2354:x1875739244793216:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844642.718936:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844642.718944:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b1 expref: 23 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.718959:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b1 expref: 23 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.718989:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844642.718995:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.719007:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.719016:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.719039:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844642.719118:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:2354:x1875739244793216:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 202us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844642.719128:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 40 00010000:00010000:1.0:1788844642.719475:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d96d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9b1 expref: 22 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844642.719498:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec31fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267894528:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844642.719527:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.719607:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.719615:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844642.719640:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788844642.719859:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d96e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9bf expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.719878:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9bf expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.719887:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:1.0:1788844642.719900:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788844642.719904:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61400, rc 0) 00000100:00100000:1.0:1788844642.719960:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:10402:x1875739244793088:12345-192.168.204.43@tcp:101:bash.0 Request processed in 4597us (5280us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788844642.719968:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:0.0:1788844642.722959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844642.723080:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244793472 00000100:00100000:2.0:1788844642.723095:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244793472 00000100:00100000:2.0:1788844642.723169:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:2.0:1788844642.723182:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:10402:x1875739244793472:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:2.0:1788844642.723637:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.723662:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.723689:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788844642.723756:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788844642.723789:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000128e8445 reply state 0000000086c53171 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844642.723800:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844642.723936:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:10402:x1875739244793472:12345-192.168.204.43@tcp:36:bash.0 Request processed in 755us (992us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788844642.723944:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 58 00000020:00080000:2.0:1788844642.723950:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788844642.732482:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.732510:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.732520:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.732527:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844642.732533:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.732560:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.732584:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:2.0:1788844642.732587:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844642.732616:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.732623:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d96fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844642.740705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844642.741282:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244793600 00000100:00100000:1.0:1788844642.741296:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244793600 00000100:00100000:1.0:1788844642.741394:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:1.0:1788844642.741416:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:10402:x1875739244793600:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1788844642.741450:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844642.741480:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9704 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9c6 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.742044:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.742067:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9bf expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.742078:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.742124:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9bf expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.742142:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9bf expref: 25 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844642.742158:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec31fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267894656:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844642.742293:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788844642.751989:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844642.752237:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec31fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267894656:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844642.752976:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844642.753087:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244793728 00000100:00100000:2.0:1788844642.753097:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244793728 00010000:00010000:2.0:1788844642.753151:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9bf expref: 26 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844642.753205:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:2.0:1788844642.753216:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff328a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:2356:x1875739244793728:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844642.753238:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844642.753246:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9bf expref: 26 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.753270:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9bf expref: 26 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.753307:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d96ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9bf expref: 26 pid: 5838 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.753330:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:2.0:1788844642.753336:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.753347:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.753379:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.753727:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844642.753894:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff328a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:2356:x1875739244793728:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 676us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844642.753905:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 41 00010000:00010000:1.0:1788844642.754586:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.754599:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844642.754678:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788844642.754684:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844642.754712:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.754762:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9704 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9c6 expref: 25 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.754788:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9c6 expref: 24 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.754799:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:1.0:1788844642.754818:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844642.754822:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61e00, rc 0) 00000100:00100000:1.0:1788844642.754884:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:10402:x1875739244793600:12345-192.168.204.43@tcp:101:bash.0 Request processed in 13480us (14196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844642.754894:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:0.0:1788844642.764059:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844642.764284:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244793984 00000100:00100000:1.0:1788844642.764335:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244793984 00000100:00100000:1.0:1788844642.764509:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:1.0:1788844642.764523:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:10402:x1875739244793984:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:1.0:1788844642.765009:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:10402:x1875739244793984:12345-192.168.204.43@tcp:35:bash.0 Request processed in 487us (965us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788844642.765018:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:2.0:1788844642.875325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844642.875733:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244794240 00000100:00100000:3.0:1788844642.875748:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244794240 00000100:00100000:3.0:1788844642.877077:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:3.0:1788844642.877098:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:10412:x1875739244794240:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844642.877138:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844642.877173:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9712 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9cd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844642.877314:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788844642.879067:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9712 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9cd expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.879096:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:3.0:1788844642.879100:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844642.879107:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9cd expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844642.879129:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025200, rc 0) 00000100:00100000:3.0:1788844642.879238:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:10412:x1875739244794240:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 2145us (3928us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788844642.879249:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:0.0:1788844642.886384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844642.886704:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244794368 00000100:00100000:2.0:1788844642.886719:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244794368 00000100:00100000:2.0:1788844642.886945:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:2.0:1788844642.886959:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:10412:x1875739244794368:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:2.0:1788844642.887073:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9720 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887095:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887109:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887130:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887138:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887145:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887642:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887654:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887662:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788844642.887722:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887740:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887747:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9720 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887755:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887762:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844642.887767:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887776:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9720 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887792:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:2.0:1788844642.887796:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844642.887824:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887840:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887856:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887863:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9727 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887869:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887874:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844642.887878:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887885:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9727 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887893:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eec2f43a00) 00010000:00010000:2.0:1788844642.887896:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844642.887899:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9727 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887906:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887924:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887930:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887944:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887949:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65400 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844642.887953:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887960:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887969:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:2.0:1788844642.887971:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844642.887974:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.887981:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d972e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844642.888093:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:10412:x1875739244794368:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 1135us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844642.888102:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:0.0:1788844642.890892:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844642.891091:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244794624 00000100:00100000:3.0:1788844642.891105:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244794624 00000100:00100000:3.0:1788844642.891184:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1788844642.891196:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:10412:x1875739244794624:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1788844642.891748:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:10412:x1875739244794624:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 549us (866us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788844642.891758:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1788844642.945170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844642.948020:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244794880 00000100:00100000:2.0:1788844642.948044:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244794880 00000100:00100000:2.0:1788844642.948171:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:2.0:1788844642.948183:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:10415:x1875739244794880:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844642.948339:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844642.948371:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9735 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9d4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.948715:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d973c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.948734:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d973c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.948747:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d973c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.948764:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.948771:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.948778:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.951263:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d974a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.951292:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d974a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.951308:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d974a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844642.951326:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788844642.952796:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d973c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952830:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d973c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952858:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d973c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952865:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844642.952871:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d973c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952881:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d973c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952901:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:2.0:1788844642.952905:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844642.952911:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d973c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952918:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d973c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952938:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952944:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9743 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952949:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952954:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844642.952957:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952974:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9743 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952984:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eec2f43a00) 00010000:00010000:2.0:1788844642.952986:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844642.952989:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9743 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.952995:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.953070:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9735 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9d4 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.953087:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d974a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9d4 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844642.953095:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:2.0:1788844642.953098:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788844642.953100:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64800, rc 0) 00000100:00100000:2.0:1788844642.953195:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10415:x1875739244794880:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 5012us (8040us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788844642.953206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:0.0:1788844642.959838:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844642.960057:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244795008 00000100:00100000:1.0:1788844642.960072:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244795008 00000100:00100000:1.0:1788844642.960145:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:1.0:1788844642.960157:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10415:x1875739244795008:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:1.0:1788844642.960272:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9758 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.960302:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.960316:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.960351:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.960358:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9758 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.960365:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9758 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.960371:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844642.960377:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9758 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.960685:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9758 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.960703:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:1.0:1788844642.960707:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788844642.960713:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9758 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.960720:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9758 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844642.960996:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10415:x1875739244795008:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 838us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844642.961007:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:2.0:1788844642.963241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844642.964704:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244795136 00000100:00100000:1.0:1788844642.964726:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244795136 00000100:00100000:1.0:1788844642.965511:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:1.0:1788844642.965532:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:2355:x1875739244795136:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844642.965592:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844642.965627:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d974a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9d4 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844642.965654:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:1.0:1788844642.965660:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844642.965758:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+28:2355:x1875739244795136:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 235us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844642.965766:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:0.0:1788844642.973185:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844642.974689:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244795392 00000100:00100000:3.0:1788844642.974709:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244795392 00000100:00100000:3.0:1788844642.974857:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:3.0:1788844642.974871:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+28:10415:x1875739244795392:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1788844642.975296:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10415:x1875739244795392:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 419us (2129us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788844642.975306:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:2.0:1788844643.071688:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec31fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267894784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844643.071793:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844643.072198:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267894784 00000100:00100000:0.0:1788844643.072210:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267894784 00000100:00100000:0.0:1788844643.072283:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788844643.072302:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875739267894784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788844643.072352:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844643.072422:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875739267894784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844643.072430:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788844643.072941:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec31fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267894784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844643.177691:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844643.178019:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244795648 00000100:00100000:3.0:1788844643.178034:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244795648 00000100:00100000:3.0:1788844643.178113:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:3.0:1788844643.178125:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10433:x1875739244795648:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:3.0:1788844643.178159:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844643.178186:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d975f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9db expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844643.178380:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9766 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844643.178398:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9766 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844643.178410:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9766 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844643.178423:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788844643.178957:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d975f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9db expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844643.178981:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9766 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9db expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844643.179010:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844643.179013:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788844643.179017:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:3.0:1788844643.179152:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10433:x1875739244795648:12345-192.168.204.43@tcp:101:cat.0 Request processed in 1028us (1474us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788844643.179161:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:1.0:1788844643.204517:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844643.204896:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244795776 00000100:00100000:2.0:1788844643.204910:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244795776 00000100:00100000:2.0:1788844643.204984:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 65 00000100:00100000:2.0:1788844643.204995:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10434:x1875739244795776:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844643.205024:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844643.205399:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844643.205496:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d977b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844643.205514:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d977b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844643.205529:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d977b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844643.205621:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788844643.205626:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844643.205647:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d977b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844643.205685:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e2 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844643.205708:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d977b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e2 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844643.205718:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:2.0:1788844643.205742:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844643.205746:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64e00, rc 0) 00000100:00100000:2.0:1788844643.205829:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10434:x1875739244795776:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 835us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844643.205838:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 65 00000100:00100000:0.0:1788844643.214482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844643.214853:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244796160 00000100:00100000:1.0:1788844643.214867:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244796160 00000100:00100000:1.0:1788844643.216360:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:1.0:1788844643.216381:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10434:x1875739244796160:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844643.216921:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10434:x1875739244796160:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 545us (2451us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788844643.216932:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:0.0:1788844643.226238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844643.226639:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244796288 00000100:00100000:3.0:1788844643.226655:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244796288 00000100:00100000:3.0:1788844643.226752:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:3.0:1788844643.226766:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff328000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10434:x1875739244796288:12345-192.168.204.43@tcp:103:lfs.0 00010000:00010000:3.0:1788844643.226789:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788844643.226890:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d970b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9c6 expref: 33 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844643.226922:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9766 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9db expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844643.226937:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d960f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f987 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844643.226949:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844643.226962:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844643.227161:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff328000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:10434:x1875739244796288:12345-192.168.204.43@tcp:103:lfs.0 Request processed in 398us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844643.227171:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:2.0:1788844643.229773:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844643.229841:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244796416 00000100:00100000:3.0:1788844643.229855:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244796416 00000100:00100000:3.0:1788844643.229997:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:3.0:1788844643.230007:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:10434:x1875739244796416:12345-192.168.204.43@tcp:58:lfs.0 00010000:00010000:3.0:1788844643.230192:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9782 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844643.230217:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9782 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844643.230231:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9782 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788844643.233239:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788844643.234108:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788844643.234200:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788844643.234826:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:10434:x1875739244796416:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 4809us (5057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844643.234843:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:0.0:1788844643.261936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844643.262093:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244796544 00000100:00100000:1.0:1788844643.262108:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244796544 00000100:00100000:1.0:1788844643.262204:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 67 00000100:00100000:1.0:1788844643.262218:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:10436:x1875739244796544:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844643.262248:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844643.262293:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9789 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9e9 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.262389:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9790 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.262408:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9790 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.262829:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9790 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.262849:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9797 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.262858:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.262886:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.264280:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.264368:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.264381:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844643.264530:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788844643.266775:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844643.266855:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.266881:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.266893:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9790 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.266900:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9790 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.266909:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9790 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.266915:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844643.266920:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9790 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.266954:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9790 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.266974:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:1.0:1788844643.266977:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844643.266982:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9790 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.266989:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9790 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.267012:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.267018:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9797 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.267025:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.267030:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844643.267033:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.267039:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9797 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.267046:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eec7351a00) 00010000:00010000:1.0:1788844643.267872:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844643.267881:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9797 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.267907:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9797 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.267977:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9789 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e9 expref: 32 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.267992:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e9 expref: 31 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844643.268001:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf900) 00010000:00010000:1.0:1788844643.268004:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788844643.268007:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60600, rc 0) 00000100:00100000:1.0:1788844643.268125:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10436:x1875739244796544:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 5909us (6208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844643.268135:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 67 00010000:00010000:3.0:1788844643.529463:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844643.578584:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec31fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267894912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844643.578688:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844643.578983:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267894912 00000100:00100000:1.0:1788844643.578994:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267894912 00000100:00100000:1.0:1788844643.579066:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788844643.579076:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267894912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788844643.579127:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844643.579201:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267894912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844643.579210:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788844643.579259:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec31fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267894912:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788844644.154312:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788844644.154327:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788844644.154408:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788844644.154417:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788844644.158144:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff32ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267895040:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788844644.159748:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cc29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844644.162191:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844644.166381:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244796672 00000100:00100000:1.0:1788844644.166403:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244796672 00000100:00100000:1.0:1788844644.166523:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:1.0:1788844644.166590:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10447:x1875739244796672:12345-192.168.204.43@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788844644.166754:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10447:x1875739244796672:12345-192.168.204.43@tcp:900:lhsmtool_posix.0 Request processed in 218us (4575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844644.166764:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00080000:0.0:1788844644.167238:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844644.169084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844644.169122:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff32ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267895040:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788844644.169289:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244796800 00000100:00100000:0.0:1788844644.169319:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244796800 00000100:00100000:0.0:1788844644.169513:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:0.0:1788844644.169525:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10447:x1875739244796800:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788844644.169589:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788844644.169858:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10447:x1875739244796800:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 335us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844644.169867:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:3.0:1788844644.179977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844644.182717:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244796928 00000100:00100000:2.0:1788844644.182741:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244796928 00000100:00100000:2.0:1788844644.182862:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:2.0:1788844644.182874:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10447:x1875739244796928:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788844644.183725:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d97a5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.183749:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d97a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.183769:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d97a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.184595:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d97ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185320:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d97ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185337:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d97ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185372:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185381:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185388:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844644.185498:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788844644.185503:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844644.185516:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185528:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d97a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185566:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d97a5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185574:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d97a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185596:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844644.185601:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d97a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185608:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d97a5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185621:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:2.0:1788844644.185624:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844644.185628:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d97a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185634:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d97a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185650:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d97ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185657:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d97ac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185663:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d97ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185669:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844644.185671:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d97ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185678:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d97ac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185694:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844644.185697:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844644.185699:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d97ac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185705:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d97ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185719:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185725:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185730:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185735:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844644.185738:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185743:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185749:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf900) 00010000:00010000:2.0:1788844644.185751:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844644.185753:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.185758:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d97b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844644.185858:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10447:x1875739244796928:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 Request processed in 2982us (5901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844644.185869:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:1.0:1788844644.189876:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844644.190271:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244797184 00000100:00100000:2.0:1788844644.190282:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244797184 00000100:00100000:2.0:1788844644.190343:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:2.0:1788844644.190354:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10447:x1875739244797184:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788844644.190373:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844644.190394:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d97ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190507:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d97c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190521:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d97c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190533:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d97c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844644.190581:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788844644.190689:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d97c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190698:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d97c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190705:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d97c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190722:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844644.190726:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d97c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190735:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d97c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190749:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf900) 00010000:00010000:2.0:1788844644.190753:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844644.190758:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d97c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190764:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d97c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190815:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d97ba lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9f0 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190825:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:2.0:1788844644.190827:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788844644.190831:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d97ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9f0 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.190839:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64200, rc 0) 00000100:00100000:2.0:1788844644.190915:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10447:x1875739244797184:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 560us (1046us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788844644.190924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:3.0:1788844644.202436:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844644.202584:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244797312 00000100:00100000:0.0:1788844644.202595:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244797312 00000100:00100000:0.0:1788844644.202665:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:0.0:1788844644.202677:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10447:x1875739244797312:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788844644.202715:0:8217:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788844644.202839:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10447:x1875739244797312:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 164us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844644.202848:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:1.0:1788844644.210876:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844644.211012:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244797568 00000100:00100000:3.0:1788844644.211035:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244797568 00000100:00100000:3.0:1788844644.211116:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 72 00000100:00100000:3.0:1788844644.211130:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10447:x1875739244797568:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844644.211171:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844644.211176:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788844644.211217:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d977b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e2 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.211243:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844644.211251:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844644.211282:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d97cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9f7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788844644.217592:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788844644.218616:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d97d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.218644:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d97d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.218660:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d97d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.218759:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d97cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9f7 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.218798:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d97d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9f7 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.218810:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844644.218813:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844644.218818:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025c00, rc 0) 00000100:00100000:3.0:1788844644.218939:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10447:x1875739244797568:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 7811us (8072us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788844644.218951:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 72 00000100:00100000:2.0:1788844644.227958:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844644.228218:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244797824 00000100:00100000:3.0:1788844644.228236:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244797824 00000100:00100000:3.0:1788844644.228327:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00100000:3.0:1788844644.228340:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10447:x1875739244797824:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788844644.228431:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844644.228483:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d97d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9f7 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.228512:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cf100) 00010000:00010000:3.0:1788844644.228706:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844644.228743:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d97e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.228762:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d97e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.228797:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d97e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.228817:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d97eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf0d4f2c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.228825:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d97eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0d4f2c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.228833:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d97eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0d4f2c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229320:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d97e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229331:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d97e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229339:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d97e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229345:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844644.229358:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d97e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229368:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d97e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229380:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844644.229383:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844644.229388:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d97e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229394:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d97e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229406:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d97eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0d4f2c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229413:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d97eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0d4f2c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229418:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d97eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0d4f2c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229423:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844644.229426:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d97eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0d4f2c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229432:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d97eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf0d4f2c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229441:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf0d4f2c5 (ffff91eed38cfe00) 00010000:00010000:3.0:1788844644.229444:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844644.229456:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d97eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf0d4f2c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.229463:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d97eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf0d4f2c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844644.230157:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10447:x1875739244797824:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 1811us (2208us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788844644.230169:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00100000:1.0:1788844644.235418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844644.235849:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244797952 00000100:00100000:3.0:1788844644.235866:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244797952 00000100:00100000:3.0:1788844644.235960:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:3.0:1788844644.235974:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10447:x1875739244797952:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844644.236020:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844644.236056:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d97f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793f9fe expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.236106:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.236124:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.236260:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.236399:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d97f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9fe expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.236424:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9fe expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.236435:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cfc00) 00010000:00010000:3.0:1788844644.236447:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788844644.236464:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025600, rc 0) 00000100:00100000:3.0:1788844644.237471:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10447:x1875739244797952:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 609us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844644.237485:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:0.0:1788844644.245509:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844644.246355:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244798208 00000100:00100000:3.0:1788844644.246374:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244798208 00000100:00100000:3.0:1788844644.246470:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:3.0:1788844644.246485:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10447:x1875739244798208:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788844644.248208:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.248240:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.248256:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788844644.258115:0:8217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788844644.258150:0:8217:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358536612736ns, next at 359536598183ns, rc = 0 00000004:00010000:3.0:1788844644.258303:0:8217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c161fa95 reply state 00000000da1e4a56 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844644.258318:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788844644.258503:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:10447:x1875739244798208:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 12015us (12995us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788844644.258514:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 75 00010000:00010000:3.0:1788844644.265004:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.265113:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.265123:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.265129:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844644.265192:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.265205:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.265229:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cfc00) 00010000:00010000:3.0:1788844644.265233:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788844644.265239:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.265245:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9800 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844644.271575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844644.271801:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244798336 00000100:00100000:3.0:1788844644.271820:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244798336 00000100:00100000:3.0:1788844644.271915:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:3.0:1788844644.273271:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:10447:x1875739244798336:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844644.273320:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844644.273356:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa05 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.273446:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa05 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.273488:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa05 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.273514:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cfc00) 00010000:00010000:3.0:1788844644.273519:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788844644.273523:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:3.0:1788844644.276455:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:10447:x1875739244798336:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 4508us (4907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844644.276473:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:2.0:1788844644.288729:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844644.288803:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244798464 00000100:00100000:2.0:1788844644.288815:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244798464 00000100:00100000:2.0:1788844644.288871:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:2.0:1788844644.288879:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875739244798464:12345-192.168.204.43@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788844644.288915:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:2.0:1788844644.288946:0:6686:0:(genops.c:1385:class_connect()) connect: client 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1, cookie 0x7f1093851e2d980e 00002000:00100000:2.0:1788844644.288959:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1/ffff91eed83d3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788844644.288970:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788844644.289244:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788844644.289272:0:6686:0:(import.c:65:import_set_state_nolock()) ffff91eed83d6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788844644.289577:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2353:x1875739244798464:12345-192.168.204.43@tcp:8:lhsmtool_posix.0 Request processed in 695us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844644.289585:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:3.0:1788844644.292251:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844644.293211:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244798592 00000100:00100000:0.0:1788844644.293228:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244798592 00000100:00100000:1.0:1788844644.293524:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:1.0:1788844644.293566:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:0:x1875739244798592:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788844644.298626:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788844644.397043:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1788844644.397071:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000100:00100000:0.0:1788844644.400546:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:0:x1875739244798592:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 104388us (105687us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788844644.400568:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:0.0:1788844644.409486:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844644.410377:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244798848 00000100:00100000:3.0:1788844644.410391:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244798848 00000100:00100000:3.0:1788844644.410471:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:3.0:1788844644.410483:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:10447:x1875739244798848:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788844644.413786:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+36:10447:x1875739244798848:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 3272us (4281us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788844644.413806:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1788844644.427303:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844644.430852:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244799104 00000100:00100000:0.0:1788844644.430894:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244799104 00000100:00100000:0.0:1788844644.430997:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 77 00000100:00100000:0.0:1788844644.431321:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+36:10447:x1875739244799104:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788844644.431498:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+36:10447:x1875739244799104:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 489us (4210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844644.431507:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 77 00000100:00100000:1.0:1788844644.435327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844644.435585:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244799232 00000100:00100000:0.0:1788844644.435599:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244799232 00000100:00100000:0.0:1788844644.435669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:0.0:1788844644.435681:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+36:10447:x1875739244799232:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788844644.435706:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844644.435732:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d9815 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa0c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844644.435836:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d981c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844644.435864:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d981c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844644.435878:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d981c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844644.435930:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788844644.435954:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d981c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844644.435985:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d9815 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa0c expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844644.436049:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d981c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa0c expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844644.436060:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cfc00) 00010000:00010000:0.0:1788844644.436063:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788844644.436067:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030c00, rc 0) 00000100:00100000:0.0:1788844644.436156:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:10447:x1875739244799232:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 477us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844644.436165:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:0.0:1788844644.443487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844644.443784:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244799360 00000100:00100000:3.0:1788844644.443799:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244799360 00000100:00100000:3.0:1788844644.443877:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:3.0:1788844644.443890:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244799360:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844644.443914:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844644.443958:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000786d350/0x7f1093851e2d9823 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa13 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788844644.444032:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9a63, blocks: 0x1 00010000:00010000:3.0:1788844644.444060:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1788844644.444067:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844644.444080:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000786d350/0x7f1093851e2d9823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa13 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.444106:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000786d350/0x7f1093851e2d9823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa13 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.444124:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844644.444224:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244799360:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 337us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844644.444233:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:0.0:1788844644.462709:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844644.463205:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244799616 00000100:00100000:1.0:1788844644.463220:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244799616 00000100:00100000:1.0:1788844644.463303:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:1.0:1788844644.463316:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:10447:x1875739244799616:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788844644.463488:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:10447:x1875739244799616:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 173us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844644.463497:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:1.0:1788844644.468440:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844644.468793:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244799744 00000100:00100000:3.0:1788844644.468806:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244799744 00000100:00100000:3.0:1788844644.468886:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:3.0:1788844644.468898:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:10447:x1875739244799744:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844644.468933:0:7066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844644.468963:0:7066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa1a expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.469120:0:7066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000786d350/0x7f1093851e2d9823 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa13 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.469169:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844644.469174:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844644.469181:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.469229:0:7066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000786d350/0x7f1093851e2d9823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa13 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.469246:0:7066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000786d350/0x7f1093851e2d9823 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa13 expref: 7 pid: 6686 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844644.469334:0:7066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7066:1875739267895168:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844644.469636:0:7066:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67000 going to sleep for 11 seconds 00000100:00100000:0.0:1788844644.477237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844644.477868:0:7066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7066:1875739267895168:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844644.477917:0:7066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.477951:0:7066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024e00, rc 0) 00000100:00100000:1.0:1788844644.478045:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:10447:x1875739244799744:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 9148us (9620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844644.478077:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:1.0:1788844644.478146:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244799872 00000100:00100000:1.0:1788844644.478155:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244799872 00010000:00010000:1.0:1788844644.478196:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000786d350/0x7f1093851e2d9823 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa13 expref: 7 pid: 6686 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844644.478233:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:1.0:1788844644.478244:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244799872:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844644.478272:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844644.478303:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000786d350/0x7f1093851e2d9823 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa13 expref: 7 pid: 6686 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.478318:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000786d350/0x7f1093851e2d9823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa13 expref: 7 pid: 6686 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.478348:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000786d350/0x7f1093851e2d9823 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa13 expref: 7 pid: 6686 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.478364:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844644.478368:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844644.478378:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 6 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.478608:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 6 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.478668:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 6 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844644.478687:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01620a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1875739267895296:192.168.204.43@tcp:105: 00000100:00100000:1.0:1788844644.478763:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff91edc12f8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788844644.487407:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844644.487471:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244800000 00000100:00100000:1.0:1788844644.487483:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244800000 00002000:00100000:1.0:1788844644.487585:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91eef3e22a00 x1875739244800000/t0(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:505/0 lens 504/0 e 0 to 0 dl 1788844655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788844644.487596:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eef3e22a00 with x1875739244800000 ext(0->8) 00002000:00010000:1.0:1788844644.487603:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eef3e22a00 00000100:00100000:1.0:1788844644.487637:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:1.0:1788844644.487647:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244800000:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788844644.488531:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01620a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1875739267895296:192.168.204.43@tcp:105: 00010000:00010000:3.0:1788844644.488583:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844644.488668:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244799872:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 10425us (11447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844644.488680:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:1.0:1788844644.494759:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2355:x1875739244800000:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 Request processed in 7100us (7363us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788844644.494786:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00002000:00100000:1.0:1788844644.494802:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91eef3e22a00 x1875739244800000/t4294967302(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:505/0 lens 504/448 e 0 to 0 dl 1788844655 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788844644.494814:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eef3e22a00 with x1875739244800000 ext(0->8) 00002000:00010000:1.0:1788844644.494820:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eef3e22a00 00000100:00100000:2.0:1788844644.497926:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844644.498020:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244800128 00000100:00100000:0.0:1788844644.498035:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244800128 00000100:00100000:0.0:1788844644.498147:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:0.0:1788844644.498159:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:10447:x1875739244800128:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1788844644.545078:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788844644.557058:0:11995:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788844644.557071:0:11995:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788844644.557116:0:11995:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788844644.557122:0:11995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788844644.604835:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:10447:x1875739244800128:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 Request processed in 106656us (106903us total) trans 0 rc 0/0 00000001:00080000:1.0:1788844644.605009:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000001:00080000:1.0:1788844644.605040:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:1.0:1788844644.605079:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000020:00080000:1.0:1788844644.605111:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1788844644.605126:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788844644.605135:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788844644.605180:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788844644.605194:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788844644.605421:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267895424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788844644.605517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844644.605638:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267895424 00000100:00100000:1.0:1788844644.605650:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267895424 00000100:00100000:1.0:1788844644.605725:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788844644.605737:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267895424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788844644.606002:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788844644.606006:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788844643 00002000:00010000:1.0:1788844644.606009:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788844644.606011:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788844643 -> 1788844643 00002000:00010000:1.0:1788844644.606015:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788844644.606062:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875739267895424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 327us (557us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788844644.606072:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788844644.606131:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eeff31ed80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788844644.606139:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267895424:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788844644.606236:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844644.606257:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:3.0:1788844644.613462:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844644.615572:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244800256 00000100:00100000:1.0:1788844644.615593:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244800256 00000100:00100000:1.0:1788844644.615679:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:1.0:1788844644.615692:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244800256:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788844644.683584:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788844644.683608:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788844644.683880:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244800256:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 Request processed in 68180us (70489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844644.684229:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:0.0:1788844644.687585:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844644.687687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244800512 00000100:00100000:1.0:1788844644.687701:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244800512 00000100:00100000:1.0:1788844644.687785:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00100000:1.0:1788844644.687799:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:10447:x1875739244800512:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788844644.687887:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844644.687927:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d981c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa0c expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.687949:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cfc00) 00010000:00010000:1.0:1788844644.687955:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788844644.687999:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.688020:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.688033:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788844644.688664:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df5a7372 reply state 000000005ae8ad12 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844644.688677:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788844644.688943:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10447:x1875739244800512:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 1144us (1421us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788844644.688952:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 81 00010000:00010000:3.0:1788844644.698650:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.698697:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.698706:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.698714:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844644.698720:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.698730:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844644.698741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:3.0:1788844644.698760:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cfc00) 00010000:00010000:3.0:1788844644.698773:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844644.698779:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.698786:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9831 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844644.698796:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244800640 00000100:00100000:2.0:1788844644.698812:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244800640 00000100:00100000:2.0:1788844644.698884:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:2.0:1788844644.698905:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244800640:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788844644.699310:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788844644.699315:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788844643 -> 1788844642 00002000:00010000:2.0:1788844644.699319:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788844640 00002000:00010000:2.0:1788844644.699321:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788844643 -> 1788844642 00002000:00010000:2.0:1788844644.699324:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788844644.700560:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244800640:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 1636us (1809us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788844644.700575:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:0.0:1788844644.705903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844644.706095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244800896 00000100:00100000:2.0:1788844644.706114:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244800896 00000100:00100000:2.0:1788844644.706205:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:2.0:1788844644.706218:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:10447:x1875739244800896:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788844644.706330:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.706465:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9fe expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.706479:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.709719:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9fe expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.709784:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9fe expref: 13 pid: 5839 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844644.709833:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3fcbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267895552:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844644.710157:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec7157840 going to sleep for 11 seconds 00000100:00100000:2.0:1788844644.730584:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3fcbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267895552:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844644.730634:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844644.730653:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844644.730713:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244801024 00000100:00100000:1.0:1788844644.730733:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244801024 00010000:00010000:1.0:1788844644.730804:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9fe expref: 14 pid: 5839 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844644.730857:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:1.0:1788844644.730880:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff328a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:2354:x1875739244801024:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844644.730902:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844644.730912:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9fe expref: 14 pid: 5839 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.730928:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9fe expref: 14 pid: 5839 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.730961:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d97f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9fe expref: 14 pid: 5839 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.730978:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cfc00) 00010000:00010000:1.0:1788844644.730984:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.730996:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.731006:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.734600:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844644.734712:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff328a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2354:x1875739244801024:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 3833us (4070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844644.734746:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00010000:00010000:3.0:1788844644.737087:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.737108:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.737154:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.737162:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.737181:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.737188:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844644.737193:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.737203:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.737224:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cfc00) 00010000:00010000:3.0:1788844644.737229:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788844644.737234:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.737241:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9838 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844644.737356:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:10447:x1875739244800896:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 Request processed in 31134us (31465us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788844644.737369:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:0.0:1788844644.747065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844644.748116:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244801152 00000100:00100000:3.0:1788844644.748137:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244801152 00000100:00100000:3.0:1788844644.748222:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:3.0:1788844644.748233:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244801152:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788844644.748279:0:7066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.748304:0:7066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.748331:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788844644.748337:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844644.748343:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.748398:0:7066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.748415:0:7066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 7 pid: 7066 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844644.748432:0:7066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7066:1875739267895680:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844644.748570:0:7066:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67900 going to sleep for 11 seconds 00000100:00100000:3.0:1788844644.764001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844644.764069:0:7066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7066:1875739267895680:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844644.764117:0:7066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844644.765978:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244801280 00000100:00100000:1.0:1788844644.765998:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244801280 00010000:00010000:1.0:1788844644.766457:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 8 pid: 7066 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844644.766515:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:1.0:1788844644.766866:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244801280:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844644.766889:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844644.766983:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 8 pid: 7066 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.767001:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 8 pid: 7066 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.767403:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d982a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa1a expref: 8 pid: 7066 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.767424:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788844644.767429:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788844644.767436:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.767449:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.767509:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788844644.767637:0:7066:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.767649:0:7066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.767682:0:7066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.767692:0:7066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.767702:0:7066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.767722:0:7066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844644.767728:0:7066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.767739:0:7066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.767756:0:7066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.767773:0:7066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d983f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844644.776258:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244801280:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 9711us (12250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844644.776281:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:2.0:1788844644.783045:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244801152:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 Request processed in 32299us (33484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844644.783068:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:2.0:1788844644.790006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844644.792824:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244801536 00000100:00100000:3.0:1788844644.792842:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244801536 00000100:00100000:3.0:1788844644.792918:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00100000:3.0:1788844644.792928:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:10447:x1875739244801536:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788844644.793009:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9846 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.793027:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.793039:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.793316:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.793329:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9807 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa05 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.793337:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.793377:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa05 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.793406:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9807 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa05 expref: 13 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844644.793422:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267895808:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844644.793533:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844644.804323:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267895808:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844644.804443:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844644.805873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844644.806085:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244801664 00000100:00100000:1.0:1788844644.806099:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244801664 00010000:00010000:1.0:1788844644.806154:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9807 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa05 expref: 14 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844644.806207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:1.0:1788844644.806220:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:2354:x1875739244801664:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844644.806241:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844644.808097:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9807 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa05 expref: 14 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.808123:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa05 expref: 14 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.808164:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa05 expref: 14 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.808194:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cfc00) 00010000:00010000:1.0:1788844644.808200:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.808212:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.808236:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.811048:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844644.811193:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2354:x1875739244801664:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 4955us (5639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844644.811208:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00010000:00010000:3.0:1788844644.814193:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844644.814211:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788844644.814427:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788844644.814634:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788844644.814675:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788844644.814759:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1875739267895936:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788844644.814841:0:8217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844644.814878:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67180 going to sleep for 11 seconds 00000100:00100000:2.0:1788844644.815100:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267895936 00000100:00100000:2.0:1788844644.815109:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267895936 00000100:00100000:2.0:1788844644.815176:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788844644.815185:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8217:x1875739267895936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788844644.815292:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8217:x1875739267895936:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844644.815300:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788844644.817051:0:8217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788844644.817067:0:8217:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eeff31ed80, transno 4294967303 00000100:00100000:1.0:1788844644.817088:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1875739267895936:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788844644.818519:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788844644.818699:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1875739267896064:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788844644.818804:0:8217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844644.818855:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91edc12f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788844644.819077:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267896064 00000100:00100000:3.0:1788844644.819095:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267896064 00000100:00100000:3.0:1788844644.819167:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788844644.819179:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8217:x1875739267896064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788844644.819428:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8217:x1875739267896064:12345-0@lo:1000:mdt00_003.0 Request processed in 251us (624us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788844644.819437:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788844644.822114:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1875739267896064:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788844644.822718:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822734:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822743:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822751:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844644.822758:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822801:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822827:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eed38cfc00) 00010000:00010000:1.0:1788844644.822831:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788844644.822837:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822845:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d984d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822906:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9782 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822914:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9782 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822920:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9782 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822926:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844644.822930:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9782 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822937:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9782 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.822948:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf900) 00010000:00010000:1.0:1788844644.822951:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788844644.823100:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9782 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.823119:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9782 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.823227:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.823247:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e9 expref: 16 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.823326:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.823502:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e9 expref: 16 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844644.823526:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e9 expref: 16 pid: 8217 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844644.830130:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267896192:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844644.831607:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91edc12f8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788844644.839430:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267896192:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844644.839476:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844644.841064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844644.841297:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244801792 00000100:00100000:2.0:1788844644.841309:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244801792 00010000:00010000:2.0:1788844644.841371:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e9 expref: 17 pid: 8217 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844644.841415:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:2.0:1788844644.841427:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:2355:x1875739244801792:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844644.841446:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844644.841454:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e9 expref: 17 pid: 8217 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.841470:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e9 expref: 17 pid: 8217 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.841500:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d979e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793f9e9 expref: 17 pid: 8217 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.841519:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf900) 00010000:00010000:2.0:1788844644.841525:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.841826:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.841838:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.841876:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844644.841950:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:2355:x1875739244801792:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 524us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844644.841978:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 46 00010000:00010000:2.0:1788844644.842785:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842801:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842819:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842827:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842835:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842842:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844644.842847:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842856:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842873:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf900) 00010000:00010000:2.0:1788844644.842877:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844644.842882:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842889:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61c00/0x7f1093851e2d9854 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842907:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9846 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842927:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9846 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842933:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9846 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842939:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844644.842943:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9846 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842950:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9846 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842962:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed38cf900) 00010000:00010000:2.0:1788844644.842964:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788844644.842967:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9846 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.842973:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9846 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844644.843866:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:10447:x1875739244801536:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 50928us (53870us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788844644.843880:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 83 00000020:00080000:3.0:1788844644.843887:0:8217:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788844644.844472:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788844644.844479:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788844644.844513:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788844644.844523:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788844644.853139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844644.856961:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244802048 00000100:00100000:2.0:1788844644.856986:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244802048 00000100:00100000:2.0:1788844644.857085:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:2.0:1788844644.857099:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:10447:x1875739244802048:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788844644.864299:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788844644.864481:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788844644.864652:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.864673:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.864688:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.864699:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.864707:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.864713:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.864740:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788844644.864904:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:10447:x1875739244802048:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 7802us (11777us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788844644.864917:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000020:00080000:2.0:1788844644.864924:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788844644.864971:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844644.864980:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.864988:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844644.864993:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.865017:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.865034:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91eec2f43f00) 00010000:00010000:2.0:1788844644.865037:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788844644.865042:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.865048:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d985b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844644.865067:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844644.865071:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844644.865075:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844645.561796:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788844646.358023:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1788844646.358338:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1788844646.586185:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788844646.793019:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788844646.793028:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788844646.793065:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788844646.793073:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788844647.050979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844647.051188:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244802304 00000100:00100000:0.0:1788844647.051209:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244802304 00000100:00100000:0.0:1788844647.051360:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:0.0:1788844647.051370:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:10467:x1875739244802304:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1788844647.051396:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844647.051418:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031800/0x7f1093851e2d9862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa21 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.051533:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d9869 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.051580:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d9869 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.051602:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d9869 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844647.051613:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788844647.051747:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031800/0x7f1093851e2d9862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa21 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.051765:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d9869 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa21 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.051773:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:0.0:1788844647.051776:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788844647.051780:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031a00, rc 0) 00000100:00100000:0.0:1788844647.051851:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:10467:x1875739244802304:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 483us (885us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788844647.051859:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00080000:1.0:1788844647.061052:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844647.067223:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844647.067761:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244802432 00000100:00100000:1.0:1788844647.067771:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244802432 00000100:00100000:1.0:1788844647.067838:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:1.0:1788844647.067850:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:10467:x1875739244802432:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:1.0:1788844647.067928:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9877 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.067958:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9877 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.067970:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9877 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.067987:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d987e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.067995:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d987e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068001:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d987e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068440:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068449:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068457:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788844647.068497:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068509:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9877 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068516:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9877 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068533:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9877 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068577:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844647.068582:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9877 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068590:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9877 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068603:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:1.0:1788844647.068606:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844647.068611:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9877 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068617:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9877 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068641:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d987e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068647:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d987e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068652:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d987e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068657:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844647.068659:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d987e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068675:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d987e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068683:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eec7351c00) 00010000:00010000:1.0:1788844647.068685:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844647.068688:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d987e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068694:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d987e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068707:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068712:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068729:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068735:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844647.068737:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068742:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068749:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:1.0:1788844647.068752:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844647.068754:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.068770:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9885 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844647.070480:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:10467:x1875739244802432:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 2610us (3256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844647.070494:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:0.0:1788844647.150479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.150824:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244802688 00000100:00100000:3.0:1788844647.150834:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244802688 00000100:00100000:3.0:1788844647.151078:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:3.0:1788844647.151089:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:10470:x1875739244802688:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844647.151133:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844647.151153:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d988c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151240:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9893 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151256:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9893 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151266:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9893 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151281:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d989a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151288:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d989a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151294:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d989a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151820:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151829:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151836:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844647.151846:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788844647.151949:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9893 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151956:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9893 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151963:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9893 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151968:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844647.151973:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9893 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151981:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9893 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.151993:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844647.151996:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844647.152000:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9893 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152005:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9893 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152015:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d989a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152021:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d989a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152027:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d989a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152031:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844647.152041:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d989a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152047:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d989a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152056:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eed03a8a00) 00010000:00010000:3.0:1788844647.152058:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844647.152061:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d989a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152067:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d989a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152108:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d988c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa28 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152121:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa28 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.152128:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:3.0:1788844647.152130:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844647.152132:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025600, rc 0) 00000100:00100000:3.0:1788844647.152198:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:10470:x1875739244802688:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1110us (1741us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788844647.152206:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:3.0:1788844647.159946:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844647.160142:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244802816 00000100:00100000:1.0:1788844647.160153:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244802816 00000100:00100000:1.0:1788844647.160217:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00100000:1.0:1788844647.160228:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:10470:x1875739244802816:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:1.0:1788844647.160319:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.160336:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.160347:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.160375:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.160381:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.160387:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.160392:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844647.160397:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.160421:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.160435:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:1.0:1788844647.160438:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788844647.160442:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.160447:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844647.161228:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:10470:x1875739244802816:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 310us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844647.161241:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00100000:2.0:1788844647.163563:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.163637:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244803072 00000100:00100000:3.0:1788844647.163648:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244803072 00000100:00100000:3.0:1788844647.163702:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:3.0:1788844647.163737:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:10470:x1875739244803072:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1788844647.163966:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:10470:x1875739244803072:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 229us (436us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788844647.163973:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1788844647.221055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.225418:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244803328 00000100:00100000:3.0:1788844647.225443:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244803328 00000100:00100000:2.0:1788844647.225901:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:2.0:1788844647.225912:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:9989:x1875739244803328:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1788844647.225939:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844647.225962:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d98b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa2f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.226068:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.226114:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa28 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.226123:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.226163:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa28 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.226177:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa28 expref: 23 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844647.226191:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3fc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267896320:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844647.226321:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eefaf003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844647.236875:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844647.236946:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244803456 00000100:00100000:1.0:1788844647.236957:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244803456 00000100:00100000:2.0:1788844647.236986:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3fc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267896320:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844647.236996:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa28 expref: 24 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.237014:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844647.237046:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:1.0:1788844647.237056:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:2355:x1875739244803456:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844647.237073:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844647.237080:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa28 expref: 24 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.237092:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa28 expref: 24 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.237860:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d98a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa28 expref: 24 pid: 5840 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.237877:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:1.0:1788844647.237882:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.237891:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.237898:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.237930:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844647.237997:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:2355:x1875739244803456:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 941us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844647.238004:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00010000:00010000:2.0:1788844647.238066:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.238074:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844647.238105:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788844647.238272:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d98b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa2f expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.238686:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa2f expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.238697:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:2.0:1788844647.238699:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788844647.238702:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65e00, rc 0) 00000100:00100000:2.0:1788844647.238804:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:9989:x1875739244803328:12345-192.168.204.43@tcp:101:bash.0 Request processed in 12892us (17760us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788844647.238811:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:0.0:1788844647.244945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.245193:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244803712 00000100:00100000:3.0:1788844647.245204:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244803712 00000100:00100000:3.0:1788844647.245425:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 89 00000100:00100000:3.0:1788844647.245437:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:9989:x1875739244803712:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:3.0:1788844647.245755:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.245773:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.245786:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788844647.245842:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788844647.245869:0:8217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000459a8e80 reply state 0000000083d95c0c transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844647.245878:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788844647.245925:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788844647.246032:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:9989:x1875739244803712:12345-192.168.204.43@tcp:36:bash.0 Request processed in 596us (1099us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788844647.246040:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 89 00000020:00080000:3.0:1788844647.246045:0:8217:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788844647.250078:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:0.0:1788844647.251616:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.251713:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.251732:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.251739:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844647.251744:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.251752:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.251771:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:0.0:1788844647.251774:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844647.251779:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.252610:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d98cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844647.256218:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244803840 00000100:00100000:1.0:1788844647.256236:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244803840 00000100:00100000:1.0:1788844647.256316:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:1.0:1788844647.256327:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:9989:x1875739244803840:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1788844647.256348:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844647.256370:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.256437:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa36 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.256479:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa36 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.256502:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:1.0:1788844647.256506:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788844647.256509:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61a00, rc 0) 00000100:00100000:1.0:1788844647.256596:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:9989:x1875739244803840:12345-192.168.204.43@tcp:101:bash.0 Request processed in 270us (6529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844647.256603:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:0.0:1788844647.270300:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.270428:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244803968 00000100:00100000:3.0:1788844647.270439:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244803968 00000100:00100000:3.0:1788844647.270521:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:3.0:1788844647.270533:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:9989:x1875739244803968:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844647.270589:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844647.270612:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2d98d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa3d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788844647.270650:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f9a62, atime: 0x6a9f9a60, ctime: 0x6a9f9a62, blocks: 0xb 00000100:00080000:1.0:1788844647.270663:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788844647.270675:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788844647.270680:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844647.270689:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2d98d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa3d expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.270710:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2d98d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa3d expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.270733:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025200, rc 0) 00000100:00100000:3.0:1788844647.271060:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:9989:x1875739244803968:12345-192.168.204.43@tcp:101:bash.0 Request processed in 528us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844647.271068:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:0.0:1788844647.283439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844647.283587:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244804096 00000100:00100000:1.0:1788844647.283599:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244804096 00002000:00010000:1.0:1788844647.283642:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788844647.283647:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eed05f8000 with x1875739244804096 ext(0->18446744073709551615) 00002000:00010000:1.0:1788844647.283661:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eed05f8000. 00000100:00100000:1.0:1788844647.283697:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:1.0:1788844647.283707:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2356:x1875739244804096:12345-192.168.204.43@tcp:10:bash.0 00002000:00010000:1.0:1788844647.284026:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788844647.284030:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788844642 -> 1788844646 00002000:00010000:1.0:1788844647.284033:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788844640 -> 1788844640 00002000:00010000:1.0:1788844647.284035:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788844642 -> 1788844646 00002000:00010000:1.0:1788844647.284037:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788844647.284100:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2356:x1875739244804096:12345-192.168.204.43@tcp:10:bash.0 Request processed in 393us (671us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788844647.284108:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00002000:00010000:1.0:1788844647.284120:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788844647.284123:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eed05f8000 with x1875739244804096 ext(0->18446744073709551615) 00002000:00010000:1.0:1788844647.284128:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eed05f8000. 00000100:00100000:2.0:1788844647.362645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844647.362697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.362725:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244804224 00000100:00100000:3.0:1788844647.362736:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244804224 00000100:00100000:3.0:1788844647.362801:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 295 00000100:00100000:2.0:1788844647.362802:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.362812:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244804224:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844647.362885:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244804480 00000100:00100000:0.0:1788844647.362889:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244804480 00000100:00100000:3.0:1788844647.362909:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244804224:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 98us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844647.362918:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 295 00000100:00100000:0.0:1788844647.362939:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 151 00000100:00100000:0.0:1788844647.362946:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244804480:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:3.0:1788844647.362965:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844647.362979:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244804480:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 33us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844647.362986:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 151 00000100:00100000:1.0:1788844647.363053:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244804352 00000100:00100000:1.0:1788844647.363058:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244804352 00000100:00100000:1.0:1788844647.363123:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00100000:1.0:1788844647.363131:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244804352:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844647.363163:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244804352:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 34us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844647.363169:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00080000:3.0:1788844647.363357:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788844647.379876:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844647.380014:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244804608 00000100:00100000:1.0:1788844647.380027:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244804608 00000100:00100000:1.0:1788844647.380393:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 91 00000100:00100000:1.0:1788844647.380407:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:10484:x1875739244804608:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:1.0:1788844647.380513:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d98e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380532:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d98e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380592:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d98e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380608:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d98e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380616:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d98e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380643:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d98e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380909:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380918:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380926:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788844647.380969:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380982:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d98e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380987:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d98e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.380994:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d98e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381000:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844647.381004:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d98e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381011:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d98e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381023:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:1.0:1788844647.381032:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844647.381038:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d98e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381044:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d98e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381056:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d98e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381062:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d98e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381067:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d98e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381072:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844647.381074:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d98e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381095:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d98e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381109:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eec7351a00) 00010000:00010000:1.0:1788844647.381112:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844647.381114:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d98e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381121:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d98e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381135:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381146:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381151:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381156:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844647.381159:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381164:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381172:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:1.0:1788844647.381174:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844647.381177:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.381182:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d98ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844647.381281:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:10484:x1875739244804608:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 876us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844647.381293:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 91 00000100:00100000:2.0:1788844647.439898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.440006:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244804864 00000100:00100000:3.0:1788844647.440016:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244804864 00000100:00100000:3.0:1788844647.440176:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 92 00000100:00100000:3.0:1788844647.440188:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:10487:x1875739244804864:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844647.440339:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844647.440362:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d98f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa44 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440445:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d98fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440460:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d98fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440472:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d98fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440487:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440493:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440499:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440825:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d990a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440835:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d990a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440843:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d990a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844647.440852:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788844647.440940:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d98fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440947:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d98fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440954:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d98fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440960:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844647.440964:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d98fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440971:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d98fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.440983:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844647.440986:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844647.440990:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d98fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441007:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d98fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441020:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441025:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9903 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441030:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441035:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844647.441038:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441044:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9903 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441051:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eed03a8300) 00010000:00010000:3.0:1788844647.441053:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844647.441056:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9903 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441061:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441359:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d98f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa44 expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441374:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d990a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa44 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.441389:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:3.0:1788844647.441391:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788844647.441394:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024e00, rc 0) 00000100:00100000:3.0:1788844647.441476:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10487:x1875739244804864:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1290us (1589us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788844647.441484:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 92 00000100:00100000:2.0:1788844647.445936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844647.446042:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244804992 00000100:00100000:0.0:1788844647.446054:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244804992 00000100:00100000:0.0:1788844647.446136:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:0.0:1788844647.446147:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10487:x1875739244804992:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:0.0:1788844647.446233:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.446253:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa2f expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.446263:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.446300:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa2f expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.446314:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa2f expref: 29 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844647.446330:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed05fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267896448:192.168.204.43@tcp:104: 00000100:00100000:0.0:1788844647.446425:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788844647.449652:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed05fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267896448:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844647.449681:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844647.450980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.451059:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244805248 00000100:00100000:3.0:1788844647.451069:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244805248 00000100:00100000:3.0:1788844647.451134:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:3.0:1788844647.451144:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:5596:x1875739244805248:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788844647.451452:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:5596:x1875739244805248:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 310us (479us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788844647.451461:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:1.0:1788844647.457460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.457774:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244805376 00000100:00100000:3.0:1788844647.457853:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244805376 00010000:00010000:3.0:1788844647.457898:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa2f expref: 31 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844647.457998:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:3.0:1788844647.458008:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:2354:x1875739244805376:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844647.458023:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844647.458030:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa2f expref: 31 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.458042:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa2f expref: 31 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.458093:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d98bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa2f expref: 31 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.458182:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:3.0:1788844647.458188:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.458197:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.458272:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.458349:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844647.458417:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:2354:x1875739244805376:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 410us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844647.458425:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00010000:00010000:0.0:1788844647.460303:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.460319:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.460358:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.460365:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.460372:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.460377:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844647.460382:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.460388:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.460404:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:0.0:1788844647.460407:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788844647.460411:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.460417:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9918 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844647.460529:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10487:x1875739244804992:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 14379us (14600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844647.460579:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:1.0:1788844647.464061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.464315:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244805632 00000100:00100000:3.0:1788844647.464325:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244805632 00000100:00100000:3.0:1788844647.464378:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:3.0:1788844647.464389:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:10487:x1875739244805632:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1788844647.464916:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:10487:x1875739244805632:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 526us (862us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788844647.464923:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:2.0:1788844647.602320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844647.602438:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244805888 00000100:00100000:0.0:1788844647.602449:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244805888 00000100:00100000:0.0:1788844647.602578:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:0.0:1788844647.602590:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:10498:x1875739244805888:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:0.0:1788844647.602615:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844647.602638:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d991f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa4b expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.602737:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9926 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.602752:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9926 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.602763:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9926 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.602789:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d992d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.602797:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d992d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.602803:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d992d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603091:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9934 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603109:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603116:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844647.603127:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788844647.603224:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9926 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603232:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9926 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603238:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9926 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603244:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844647.603248:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9926 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603254:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9926 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603267:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:0.0:1788844647.603270:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844647.603274:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9926 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603290:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9926 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603302:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d992d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603308:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d992d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603313:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d992d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603317:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844647.603319:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d992d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603324:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d992d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603330:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eee1796e00) 00010000:00010000:0.0:1788844647.603333:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844647.603335:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d992d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603340:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d992d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603384:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d991f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa4b expref: 33 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603398:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9934 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa4b expref: 32 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844647.603411:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:0.0:1788844647.603414:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788844647.603416:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031600, rc 0) 00000100:00100000:0.0:1788844647.603479:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10498:x1875739244805888:12345-192.168.204.43@tcp:101:cat.0 Request processed in 891us (1169us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788844647.603486:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 94 00010000:00010000:0.0:1788844647.613470:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844647.614995:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844647.615219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244806144 00000100:00100000:2.0:1788844647.615230:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244806144 00000100:00100000:2.0:1788844647.615294:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:2.0:1788844647.615305:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10498:x1875739244806144:12345-192.168.204.43@tcp:35:cat.0 00000100:00100000:2.0:1788844647.616271:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10498:x1875739244806144:12345-192.168.204.43@tcp:35:cat.0 Request processed in 961us (1276us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788844647.616283:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:1.0:1788844647.643040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.643369:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244806400 00000100:00100000:3.0:1788844647.643379:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244806400 00000100:00100000:3.0:1788844647.643447:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 95 00000100:00100000:3.0:1788844647.643455:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10499:x1875739244806400:12345-192.168.204.43@tcp:36:rm.0 00010000:00010000:3.0:1788844647.643513:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788844647.643883:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9934 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa4b expref: 33 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.643910:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d990a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa44 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.643923:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d98d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa36 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.643933:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:3.0:1788844647.643942:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844647.643963:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9942 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.643976:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.643984:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.643997:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.644003:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.644010:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.644936:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9950 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.644947:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9950 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.644956:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9950 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788844647.645651:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788844647.645663:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361924125835ns, next at 362924121562ns, rc = 0 00010000:00010000:3.0:1788844647.645736:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.645746:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.645753:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.645761:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.645768:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646330:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646353:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788844647.646377:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9950 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646394:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9950 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646399:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9950 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646405:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844647.646409:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9950 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646416:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9950 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646428:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8b00) 00010000:00010000:3.0:1788844647.646431:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788844647.646435:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9950 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646441:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9950 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646461:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646468:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9942 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646473:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9942 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646478:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844647.646487:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9942 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646494:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9942 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646502:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844647.646505:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844647.646507:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9942 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.646513:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9942 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788844647.646523:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000658a61fa reply state 000000007bd23b39 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844647.646532:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788844647.646660:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:10499:x1875739244806400:12345-192.168.204.43@tcp:36:rm.0 Request processed in 3201us (3626us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788844647.646669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 95 00010000:00010000:2.0:1788844647.646911:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844647.646917:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.646930:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844647.646933:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.646939:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.646949:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91eed03a8b00) 00010000:00010000:2.0:1788844647.646951:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788844647.646954:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.646960:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9957 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844647.646976:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844647.646977:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844647.646979:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844647.653024:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.653041:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.653048:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.653054:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844647.653059:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.653090:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.653113:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eed03a8300) 00010000:00010000:3.0:1788844647.653116:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844647.653120:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.653126:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9949 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844647.677379:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed05fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267896576:0@lo:400:kworker.0 00000100:00100000:2.0:1788844647.677462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844647.677665:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267896576 00000100:00100000:1.0:1788844647.677676:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267896576 00000100:00100000:1.0:1788844647.677735:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788844647.677762:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267896576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844647.677865:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed05faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267896960:0@lo:400:kworker.0 00000100:00100000:3.0:1788844647.677901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844647.677950:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267896960 00000100:00100000:3.0:1788844647.677953:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267896960 00000100:00100000:3.0:1788844647.677992:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788844647.677998:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875739267896960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844647.678036:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875739267896960:12345-0@lo:400:kworker.0 Request processed in 38us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844647.678043:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788844647.678112:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed05faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267896960:0@lo:400:kworker.0 00000100:00080000:3.0:1788844647.678134:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788844647.681741:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed05f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267896704:0@lo:400:kworker.0 00000100:00100000:0.0:1788844647.681821:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844647.681859:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed05f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267897216:0@lo:400:kworker.0 00000100:00100000:0.0:1788844647.681884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844647.681909:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844647.681915:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed05f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267896832:0@lo:400:kworker.0 00000100:00100000:0.0:1788844647.681936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844647.681977:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267897216 00000100:00100000:0.0:1788844647.681985:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267897216 00000100:00100000:0.0:1788844647.682049:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788844647.682058:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267897216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844647.683457:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844647.683477:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed05fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267897088:0@lo:400:kworker.0 00000100:00100000:3.0:1788844647.683531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788844647.683639:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788844647.683654:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267896704 00000100:00100000:3.0:1788844647.683673:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267896704 00000100:00100000:3.0:1788844647.683725:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267896832 00000100:00100000:3.0:1788844647.683729:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267896832 00000100:00100000:3.0:1788844647.683748:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267897088 00000100:00100000:3.0:1788844647.683751:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267897088 00000100:00100000:3.0:1788844647.683765:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788844647.683780:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267896704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844647.683839:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267896704:12345-0@lo:400:kworker.0 Request processed in 67us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844647.683846:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788844647.683863:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788844647.683869:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267896832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844647.683893:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267896832:12345-0@lo:400:kworker.0 Request processed in 25us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844647.683898:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788844647.683908:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788844647.683913:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267897088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844647.683942:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267897088:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844647.683947:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788844647.683960:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844647.683987:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed05fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267897088:0@lo:400:kworker.0 00000100:00100000:0.0:1788844647.684666:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267897216:12345-0@lo:400:kworker.0 Request processed in 2606us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844647.684677:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788844647.684732:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed05f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267896832:0@lo:400:kworker.0 00000100:00100000:0.0:1788844647.684743:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed05f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267896704:0@lo:400:kworker.0 00000100:00100000:0.0:1788844647.684751:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788844647.684767:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788844647.684796:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eefb3de680, transno 4294967301 00000100:00100000:0.0:1788844647.684810:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed05f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267897216:0@lo:400:kworker.0 00000100:00100000:1.0:1788844647.685003:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267896576:12345-0@lo:400:kworker.0 Request processed in 7243us (7539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844647.685012:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788844647.688373:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed05fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267896576:0@lo:400:kworker.0 00000100:00100000:1.0:1788844647.709729:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.709885:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244806656 00000100:00100000:3.0:1788844647.709896:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244806656 00000100:00100000:3.0:1788844647.709961:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 96 00000100:00100000:3.0:1788844647.709971:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:10505:x1875739244806656:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844647.710001:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844647.710041:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d995e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.710183:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9965 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.710197:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.710208:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.710223:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.710230:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.710236:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788844647.710813:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788844647.710971:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.710981:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.710988:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.711019:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.711036:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9965 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.711043:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9965 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.711049:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844647.711053:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9965 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.711061:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9965 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.711073:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844647.711076:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844647.711081:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9965 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.711088:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9965 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788844647.711103:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c352e055 reply state 0000000058c29795 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844647.711112:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788844647.711147:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d995e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa52 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.711161:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa52 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.711179:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:3.0:1788844647.711182:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844647.711185:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024e00, rc 0) 00000100:00100000:3.0:1788844647.711271:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:10505:x1875739244806656:12345-192.168.204.43@tcp:101:bash.0 Request processed in 1300us (1564us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788844647.711279:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 96 00010000:00010000:3.0:1788844647.717592:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.717611:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.717620:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.717627:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844647.717632:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.717640:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.717657:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eed03a8300) 00010000:00010000:3.0:1788844647.717661:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844647.717666:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.717672:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d996c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844647.719814:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.720394:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244806784 00000100:00100000:3.0:1788844647.720405:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244806784 00000100:00100000:3.0:1788844647.720470:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:3.0:1788844647.720481:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244806784:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844647.720499:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844647.720519:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2eb86f5/0x7f1093851e2d9981 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa59 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788844647.720577:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788844647.720596:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788844647.720601:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844647.720611:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2eb86f5/0x7f1093851e2d9981 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa59 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.720631:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2eb86f5/0x7f1093851e2d9981 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa59 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.720646:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025600, rc 0) 00000100:00100000:3.0:1788844647.720719:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244806784:12345-192.168.204.43@tcp:101:bash.0 Request processed in 239us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844647.720726:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:0.0:1788844647.740055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.740195:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244806912 00000100:00100000:3.0:1788844647.740206:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244806912 00000100:00100000:3.0:1788844647.740269:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:3.0:1788844647.740280:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:10505:x1875739244806912:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844647.740312:0:7066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844647.740328:0:7066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa60 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.740360:0:7066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2eb86f5/0x7f1093851e2d9981 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa59 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.740375:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788844647.740379:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844647.740385:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.740421:0:7066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2eb86f5/0x7f1093851e2d9981 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa59 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.740434:0:7066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2eb86f5/0x7f1093851e2d9981 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa59 expref: 7 pid: 6686 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844647.740449:0:7066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7066:1875739267897344:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844647.743377:0:7066:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67000 going to sleep for 11 seconds 00000100:00100000:2.0:1788844647.762893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.763692:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244807040 00000100:00100000:3.0:1788844647.763714:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244807040 00010000:00010000:3.0:1788844647.763758:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2eb86f5/0x7f1093851e2d9981 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa59 expref: 8 pid: 6686 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844647.763810:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:3.0:1788844647.763820:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244807040:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844647.764023:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844647.764046:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2eb86f5/0x7f1093851e2d9981 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa59 expref: 8 pid: 6686 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.764060:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2eb86f5/0x7f1093851e2d9981 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa59 expref: 8 pid: 6686 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.764092:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844647.764108:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844647.764118:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.764128:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844647.764167:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844647.764181:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875739267897472:192.168.204.43@tcp:105: 00000100:00100000:3.0:1788844647.764282:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec51c5e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788844647.768804:0:7066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2eb86f5/0x7f1093851e2d9981 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa59 expref: 8 pid: 6686 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844647.768839:0:7066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7066:1875739267897344:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844647.768876:0:7066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844647.768891:0:7066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:1.0:1788844647.768966:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:10505:x1875739244806912:12345-192.168.204.43@tcp:101:bash.0 Request processed in 28687us (28919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844647.768975:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:3.0:1788844647.771717:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875739267897472:192.168.204.43@tcp:105: 00010000:00010000:3.0:1788844647.771746:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844647.771815:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244807040:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 7995us (8933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844647.771826:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:0.0:1788844647.774212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844647.774405:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244807296 00000100:00100000:3.0:1788844647.774415:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244807296 00000100:00100000:3.0:1788844647.774837:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:3.0:1788844647.774849:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:10505:x1875739244807296:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:3.0:1788844647.775246:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:10505:x1875739244807296:12345-192.168.204.43@tcp:35:bash.0 Request processed in 398us (1053us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788844647.775254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:0.0:1788844648.080099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.082270:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244807424 00000100:00100000:3.0:1788844648.082289:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244807424 00000100:00100000:3.0:1788844648.082370:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 97 00000100:00100000:3.0:1788844648.082382:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:10521:x1875739244807424:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844648.082409:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844648.082430:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d998f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa67 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.082519:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.082566:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.082581:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844648.082617:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788844648.082621:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844648.082640:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.082667:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d998f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa67 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.082697:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa67 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.082719:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844648.082721:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788844648.082724:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844648.082803:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:10521:x1875739244807424:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 424us (2727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.082811:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 97 00000100:00100000:1.0:1788844648.092661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.092788:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244807680 00000100:00100000:3.0:1788844648.092800:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244807680 00000100:00100000:3.0:1788844648.092860:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00100000:3.0:1788844648.092870:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:10521:x1875739244807680:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844648.092890:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844648.092912:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d999d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa6e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.093013:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.093030:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.093042:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844648.093052:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788844648.094002:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d999d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa6e expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.094025:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa6e expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.094034:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:3.0:1788844648.094037:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844648.094040:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025600, rc 0) 00000100:00100000:3.0:1788844648.094111:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:10521:x1875739244807680:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1241us (1460us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788844648.094120:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00100000:1.0:1788844648.100283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.100563:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244807808 00000100:00100000:3.0:1788844648.100574:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244807808 00000100:00100000:3.0:1788844648.100640:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:3.0:1788844648.100651:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:2356:x1875739244807808:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844648.100668:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844648.100693:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa6e expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.100725:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:3.0:1788844648.100731:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844648.100973:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+36:2356:x1875739244807808:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 322us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.100981:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:2.0:1788844648.103047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.103198:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244808064 00000100:00100000:3.0:1788844648.103209:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244808064 00000100:00100000:3.0:1788844648.103293:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:3.0:1788844648.103303:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+36:10521:x1875739244808064:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844648.103331:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844648.103354:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d99b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa75 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.103454:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d99b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.103468:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d99b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.103479:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d99b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844648.103490:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788844648.103655:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d99b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa75 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.103674:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d99b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa75 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.103684:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:3.0:1788844648.103686:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788844648.103690:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025c00, rc 0) 00000100:00100000:3.0:1788844648.103752:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+38:10521:x1875739244808064:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 449us (714us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788844648.103758:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:1.0:1788844648.121200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.121293:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244808192 00000100:00100000:3.0:1788844648.121313:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244808192 00000100:00100000:3.0:1788844648.121377:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:3.0:1788844648.121387:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244808192:12345-192.168.204.43@tcp:1:lfs.0 00010000:00010000:3.0:1788844648.121431:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.121453:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 6 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.121462:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844648.121467:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844648.121472:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.121509:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 6 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.121524:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 6 pid: 7066 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844648.121596:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1875739267897600:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844648.121688:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cf0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788844648.126501:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1875739267897600:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844648.126532:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844648.130483:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844648.130835:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244808320 00000100:00100000:2.0:1788844648.130848:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244808320 00002000:00100000:2.0:1788844648.130903:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91eeff31f100 x1875739244808320/t0(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:509/0 lens 504/0 e 0 to 0 dl 1788844659 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788844648.130914:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eeff31f100 with x1875739244808320 ext(0->8) 00010000:00010000:2.0:1788844648.130938:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 7 pid: 7066 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.130956:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 7 pid: 7066 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788844648.130965:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eeff31f100 00000100:00100000:2.0:1788844648.131007:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:2.0:1788844648.131017:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244808320:12345-192.168.204.43@tcp:4:lfs.0 00000100:00100000:2.0:1788844648.131854:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2355:x1875739244808320:12345-192.168.204.43@tcp:4:lfs.0 Request processed in 833us (1380us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788844648.131864:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00002000:00100000:2.0:1788844648.131874:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91eeff31f100 x1875739244808320/t4294967302(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:509/0 lens 504/448 e 0 to 0 dl 1788844659 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788844648.131883:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eeff31f100 with x1875739244808320 ext(0->8) 00010000:00010000:2.0:1788844648.131889:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 9 pid: 7066 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.131903:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 9 pid: 7066 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788844648.131910:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eeff31f100 00000100:00100000:2.0:1788844648.147930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.149402:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244808448 00000100:00100000:3.0:1788844648.149417:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244808448 00010000:00010000:3.0:1788844648.149462:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 9 pid: 7066 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844648.149582:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:3.0:1788844648.149593:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2354:x1875739244808448:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844648.149609:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788844648.149629:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788844648.149632:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788844647 00002000:00010000:3.0:1788844648.149635:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788844647 00002000:00010000:3.0:1788844648.149637:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788844647 00010000:00010000:3.0:1788844648.149644:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 9 pid: 7066 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.149658:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 9 pid: 7066 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.149682:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2d9988 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa60 expref: 9 pid: 7066 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.149707:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844648.149712:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844648.149717:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.149750:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.149858:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844648.149926:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244808448:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 334us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.149935:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 50 00010000:00010000:0.0:1788844648.149994:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.150005:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.150030:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.150039:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.150047:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.150054:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844648.150058:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.150079:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.150099:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.150106:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f496aa8/0x7f1093851e2d99c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844648.150157:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244808192:12345-192.168.204.43@tcp:1:lfs.0 Request processed in 28772us (28970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844648.150165:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:2.0:1788844648.158088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844648.159478:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244808704 00000100:00100000:1.0:1788844648.159493:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244808704 00000100:00100000:1.0:1788844648.159600:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:1.0:1788844648.159610:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+38:10521:x1875739244808704:12345-192.168.204.43@tcp:35:lfs.0 00000004:00010000:1.0:1788844648.159695:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d99b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa75 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788844648.160183:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788844648.160364:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788844648.160714:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788844648.160783:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.160800:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa52 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.160810:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.161105:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa52 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.161121:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa52 expref: 42 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844648.161136:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1875739267897728:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844648.162068:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844648.174448:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844648.174601:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1875739267897728:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844648.174654:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844648.177003:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244808832 00000100:00100000:3.0:1788844648.177019:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244808832 00010000:00010000:3.0:1788844648.177084:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa52 expref: 43 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844648.177130:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:3.0:1788844648.177141:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+43:2355:x1875739244808832:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844648.177157:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844648.177165:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa52 expref: 43 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.177178:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa52 expref: 43 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.177210:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9973 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa52 expref: 43 pid: 5838 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.177226:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:3.0:1788844648.177248:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.177258:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.177266:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.177301:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844648.177379:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+42:2355:x1875739244808832:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 239us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.177387:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00010000:00010000:1.0:1788844648.177993:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.178005:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788844648.178160:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788844648.178652:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788844648.179264:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267897856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788844648.179339:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844648.179500:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844648.179583:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267897856 00000100:00100000:3.0:1788844648.179592:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267897856 00000100:00100000:3.0:1788844648.179644:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788844648.179655:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875739267897856:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788844648.179751:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875739267897856:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 98us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.179759:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788844648.181036:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267897856:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788844648.181909:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788844648.182010:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267897984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788844648.182141:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844648.182250:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67240 going to sleep for 11 seconds 00000100:00100000:2.0:1788844648.188740:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267897984 00000100:00100000:2.0:1788844648.188764:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267897984 00000100:00100000:2.0:1788844648.188858:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844648.188872:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875739267897984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788844648.189257:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875739267897984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 387us (7114us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788844648.189266:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844648.190149:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267897984:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788844648.190348:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788844648.190407:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.190419:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.190427:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.190434:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844648.190439:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.190447:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.190463:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:2.0:1788844648.190480:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788844648.190485:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.190492:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d99ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788844648.190790:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788844648.190877:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788844648.190889:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362469351304ns, next at 363469348839ns, rc = 0 00000001:00080000:2.0:1788844648.190895:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788844648.190928:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eed03a8c00) 00010000:00010000:2.0:1788844648.190931:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788844648.190938:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d99b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa75 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844648.191050:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+45:10521:x1875739244808704:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 31440us (32971us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788844648.191059:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000020:00080000:2.0:1788844648.191063:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788844648.196636:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788844648.196659:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267898112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844648.196731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844648.197585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844648.197623:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267898112 00000100:00100000:1.0:1788844648.197632:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267898112 00000100:00100000:1.0:1788844648.197693:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788844648.197712:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267898112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844648.197737:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844648.197857:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244808960 00000100:00100000:2.0:1788844648.197862:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244808960 00000100:00100000:2.0:1788844648.197905:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:2.0:1788844648.197913:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+45:10521:x1875739244808960:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844648.197930:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844648.197965:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d99d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa7c expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.198029:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d99d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa7c expref: 46 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.198058:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d99d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa7c expref: 46 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.198093:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844648.198097:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788844648.198100:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64800, rc 0) 00000100:00100000:2.0:1788844648.198150:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+46:10521:x1875739244808960:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 237us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844648.198158:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:1.0:1788844648.198402:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267898112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 692us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844648.198409:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788844648.198466:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267898112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844648.213422:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844648.213596:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244809216 00000100:00100000:2.0:1788844648.213606:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244809216 00000100:00100000:2.0:1788844648.213664:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:2.0:1788844648.213674:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+46:10521:x1875739244809216:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:2.0:1788844648.213958:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+47:10521:x1875739244809216:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 284us (547us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788844648.213966:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:1.0:1788844648.413750:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.414048:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244809344 00000100:00100000:3.0:1788844648.414060:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244809344 00000100:00100000:3.0:1788844648.414118:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:3.0:1788844648.414142:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+47:10531:x1875739244809344:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:3.0:1788844648.414234:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d99dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414251:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d99dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414263:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d99dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414278:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d99e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414285:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d99e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414291:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d99e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414395:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414405:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414412:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788844648.414462:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414474:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d99dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414488:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d99dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414495:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d99dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414502:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844648.414507:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d99dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414515:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d99dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414527:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844648.414530:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844648.414579:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d99dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414587:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d99dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414602:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d99e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414607:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d99e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414613:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d99e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414618:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844648.414628:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d99e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414635:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d99e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414643:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eed03a8300) 00010000:00010000:3.0:1788844648.414645:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844648.414648:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d99e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414653:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d99e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414667:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414674:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414680:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414685:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844648.414688:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414703:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414710:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844648.414712:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844648.414723:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.414729:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d99ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844648.414803:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+47:10531:x1875739244809344:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 662us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.414811:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:3.0:1788844648.486423:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844648.486523:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244809600 00000100:00100000:2.0:1788844648.486562:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244809600 00000100:00100000:2.0:1788844648.486640:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 102 00000100:00100000:2.0:1788844648.486651:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+47:10534:x1875739244809600:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844648.486674:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844648.486706:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d99f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa83 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.486786:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d99f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.486814:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d99f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.486828:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d99f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.486845:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d99ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.486851:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d99ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.486858:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d99ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.486993:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487002:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487008:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844648.487017:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788844648.487112:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d99f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487119:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d99f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487125:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d99f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487137:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844648.487142:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d99f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487149:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d99f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487161:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:2.0:1788844648.487164:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844648.487169:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d99f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487174:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d99f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487187:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d99ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487193:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d99ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487199:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d99ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487204:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844648.487206:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d99ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487211:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d99ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487228:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eec2f43100) 00010000:00010000:2.0:1788844648.487231:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844648.487234:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d99ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487239:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d99ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487279:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d99f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa83 expref: 50 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487293:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa83 expref: 49 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.487300:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844648.487302:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788844648.487305:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64e00, rc 0) 00000100:00100000:2.0:1788844648.487374:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+49:10534:x1875739244809600:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 725us (960us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788844648.487382:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 102 00000100:00100000:0.0:1788844648.500854:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.501125:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244809728 00000100:00100000:3.0:1788844648.501136:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244809728 00000100:00100000:3.0:1788844648.501206:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 103 00000100:00100000:3.0:1788844648.501217:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+49:10534:x1875739244809728:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:3.0:1788844648.501288:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.501304:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.501317:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.501342:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.501350:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.501357:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.501380:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844648.501384:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.501392:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.501405:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844648.501408:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844648.501413:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.501418:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844648.502884:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+49:10534:x1875739244809728:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 1659us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.502897:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 103 00000100:00100000:1.0:1788844648.518315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.518483:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244809984 00000100:00100000:3.0:1788844648.518493:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244809984 00000100:00100000:3.0:1788844648.518576:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:3.0:1788844648.518585:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+49:10534:x1875739244809984:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1788844648.519032:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+50:10534:x1875739244809984:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 445us (749us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788844648.519041:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 28 00010000:00010000:0.0:1788844648.633728:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844648.664841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.664928:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244810240 00000100:00100000:3.0:1788844648.664938:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244810240 00000100:00100000:3.0:1788844648.665001:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:3.0:1788844648.665031:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+50:10544:x1875739244810240:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844648.665056:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844648.665071:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788844648.665098:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa67 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.665119:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844648.665125:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844648.665138:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.665249:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.665262:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.665271:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844648.665281:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788844648.665423:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa8a expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.665441:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa8a expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.665448:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844648.665451:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844648.665459:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:3.0:1788844648.665533:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+51:10544:x1875739244810240:12345-192.168.204.43@tcp:101:bash.0 Request processed in 503us (702us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788844648.665595:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:0.0:1788844648.671576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844648.671674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.672025:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244810368 00000100:00100000:3.0:1788844648.672037:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244810368 00000100:00100000:3.0:1788844648.672115:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:3.0:1788844648.672125:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+51:2354:x1875739244810368:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844648.672142:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844648.672169:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa8a expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.672186:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844648.672191:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844648.672251:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+50:2354:x1875739244810368:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 127us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.672259:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:1.0:1788844648.672765:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244810624 00000100:00100000:1.0:1788844648.672771:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244810624 00000100:00100000:1.0:1788844648.672806:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 105 00000100:00100000:1.0:1788844648.672813:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+50:10544:x1875739244810624:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:1.0:1788844648.672870:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844648.672896:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2d9a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa83 expref: 50 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.672909:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:1.0:1788844648.672912:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788844648.673249:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.673264:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.673275:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788844648.673328:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788844648.673798:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbb8b7cc reply state 0000000045d51ff5 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844648.673808:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788844648.673940:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:10544:x1875739244810624:12345-192.168.204.43@tcp:36:bash.0 Request processed in 1125us (2374us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788844648.673948:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 105 00000020:00080000:1.0:1788844648.673952:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788844648.677303:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.677320:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.677327:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.677333:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844648.677339:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.677368:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.677390:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844648.677393:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844648.677398:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.677404:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9a30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844648.678171:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.678337:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244810752 00000100:00100000:3.0:1788844648.678412:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244810752 00000100:00100000:3.0:1788844648.678592:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 106 00000100:00100000:3.0:1788844648.678602:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+51:10544:x1875739244810752:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844648.678625:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844648.678645:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa91 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.678736:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.678750:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.678759:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844648.678786:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788844648.678790:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844648.678822:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.678847:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa91 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.678861:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa91 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.678870:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844648.678872:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844648.678875:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844648.678933:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:10544:x1875739244810752:12345-192.168.204.43@tcp:101:bash.0 Request processed in 331us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.678940:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 106 00000100:00100000:0.0:1788844648.687343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844648.687510:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244811008 00000100:00100000:1.0:1788844648.687520:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244811008 00000100:00100000:1.0:1788844648.687593:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:1.0:1788844648.687602:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:10544:x1875739244811008:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:1.0:1788844648.687839:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+53:10544:x1875739244811008:12345-192.168.204.43@tcp:35:bash.0 Request processed in 238us (507us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788844648.687846:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 29 00000004:00080000:2.0:1788844648.697987:0:7026:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362976447791ns, next at 363976445001ns, rc = 0 00000100:00100000:2.0:1788844648.698069:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788844648.698092:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267898240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844648.698165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844648.699601:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267898240 00000100:00100000:3.0:1788844648.699614:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267898240 00000100:00100000:3.0:1788844648.699672:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788844648.699681:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefd9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267898240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844648.699726:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844648.699798:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefd9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267898240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.699805:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788844648.699898:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267898240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844648.819519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.821629:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244811136 00000100:00100000:3.0:1788844648.821644:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244811136 00000100:00100000:3.0:1788844648.821780:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 107 00000100:00100000:3.0:1788844648.821792:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+53:10550:x1875739244811136:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844648.821818:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844648.821866:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa98 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.821936:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.821951:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.821965:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844648.822007:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788844648.822011:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844648.822030:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.822067:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa98 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.822086:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa98 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.822096:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844648.822099:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788844648.822102:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:3.0:1788844648.822189:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:10550:x1875739244811136:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 399us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.822196:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 107 00000100:00100000:2.0:1788844648.832890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.834002:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244811264 00000100:00100000:3.0:1788844648.834034:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244811264 00000100:00100000:3.0:1788844648.834094:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 108 00000100:00100000:3.0:1788844648.834103:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:10550:x1875739244811264:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844648.834123:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844648.834144:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9a53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fa9f expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834231:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9a5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834245:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834256:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834271:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9a61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834279:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834285:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834377:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834385:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834393:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844648.834437:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788844648.834442:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844648.834461:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834474:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834483:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834489:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9a5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834496:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834503:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844648.834507:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834514:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9a5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834527:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844648.834530:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844648.834568:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834577:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834605:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834610:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9a61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834616:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834622:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844648.834625:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834632:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9a61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834640:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eed03a8300) 00010000:00010000:3.0:1788844648.834643:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844648.834646:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9a61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834651:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9a61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834680:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9a53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa9f expref: 56 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834707:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa9f expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.834725:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844648.834728:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844648.834731:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0205c200, rc 0) 00000100:00100000:3.0:1788844648.834800:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:10550:x1875739244811264:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 697us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.834807:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 108 00000100:00100000:0.0:1788844648.846141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844648.846192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844648.846272:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244811520 00000100:00100000:1.0:1788844648.846282:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244811520 00000100:00100000:1.0:1788844648.846342:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 109 00000100:00100000:1.0:1788844648.846352:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:10550:x1875739244811520:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844648.846374:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844648.846395:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9a6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793faa6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.846510:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.846526:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa91 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.846571:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa9f expref: 56 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.846581:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.846618:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa9f expref: 56 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.846631:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa9f expref: 56 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844648.846660:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267898368:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844648.846782:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa91 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.846791:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa91 expref: 56 pid: 5838 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844648.846800:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267898496:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844648.846822:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67600 going to sleep for 11 seconds 00000100:00100000:2.0:1788844648.848314:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244811648 00000100:00100000:2.0:1788844648.848343:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244811648 00010000:00010000:2.0:1788844648.848386:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa9f expref: 57 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844648.848436:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:2.0:1788844648.848446:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+57:2354:x1875739244811648:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844648.848459:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844648.848465:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa9f expref: 57 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.848479:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa9f expref: 57 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.848503:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844648.848509:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.848517:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.848524:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844648.848616:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+57:2354:x1875739244811648:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 171us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844648.848624:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:0.0:1788844648.851788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:1.0:1788844648.851963:0:5840:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.43@tcp) returned -22 from blocking AST (req@000000000259e2da x1875739267898368) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa9f expref: 56 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.851988:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9a68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa9f expref: 56 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844648.852006:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267898368:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844648.852020:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267898496:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844648.852061:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:1.0:1788844648.852068:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.852077:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.852085:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844648.852212:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244811776 00000100:00100000:2.0:1788844648.852220:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244811776 00010000:00010000:2.0:1788844648.852256:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa91 expref: 56 pid: 5838 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844648.852313:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:2.0:1788844648.852322:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+56:2355:x1875739244811776:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844648.852337:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844648.852343:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa91 expref: 56 pid: 5838 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.852353:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa91 expref: 56 pid: 5838 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.852372:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9a3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa91 expref: 56 pid: 5838 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.852382:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844648.852386:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.852408:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.852416:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844648.852443:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844648.852500:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:2355:x1875739244811776:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 178us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844648.852507:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00010000:00010000:1.0:1788844648.852663:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.852677:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844648.852708:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788844648.852854:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9a6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faa6 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.852871:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faa6 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.852879:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:1.0:1788844648.852881:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788844648.852884:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61000, rc 0) 00000100:00100000:1.0:1788844648.852911:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:10550:x1875739244811520:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 6561us (6781us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788844648.852918:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 109 00000100:00100000:1.0:1788844648.860509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.860763:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244812032 00000100:00100000:3.0:1788844648.860775:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244812032 00000100:00100000:3.0:1788844648.861331:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:3.0:1788844648.861344:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:10550:x1875739244812032:12345-192.168.204.43@tcp:103:lfs.0 00010000:00010000:3.0:1788844648.861361:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844648.861400:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d99d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa7c expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.861421:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844648.861426:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844648.861490:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:10550:x1875739244812032:12345-192.168.204.43@tcp:103:lfs.0 Request processed in 149us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.861497:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1788844648.882884:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.882975:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244812160 00000100:00100000:3.0:1788844648.882985:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244812160 00000100:00100000:3.0:1788844648.883046:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 110 00000100:00100000:3.0:1788844648.883065:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:10550:x1875739244812160:12345-192.168.204.43@tcp:58:lfs.0 00010000:00010000:3.0:1788844648.883168:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.883215:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.883228:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788844648.883438:0:8217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788844648.883529:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:10550:x1875739244812160:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 464us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.883581:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 110 00000100:00100000:0.0:1788844648.896200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.896622:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244812288 00000100:00100000:3.0:1788844648.896636:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244812288 00000100:00100000:3.0:1788844648.896841:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 111 00000100:00100000:3.0:1788844648.896852:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:10550:x1875739244812288:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844648.896873:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844648.896897:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205d400/0x7f1093851e2d9a8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793faad expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.896961:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.896973:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205d400/0x7f1093851e2d9a8b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faad expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.896992:0:5839:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.897005:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205d400/0x7f1093851e2d9a8b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faad expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.897034:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844648.897037:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788844648.897041:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205d400/0x7f1093851e2d9a8b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faad expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844648.897050:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0205d400, rc 0) 00000100:00100000:3.0:1788844648.897111:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:10550:x1875739244812288:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 261us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.897118:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 111 00000040:00080000:0.0:1788844648.954771:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788844648.954781:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788844648.954837:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788844648.954843:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788844648.954964:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed05f9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267898624:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788844648.955097:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788844648.967011:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed05f9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267898624:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788844648.969056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844648.974313:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244812416 00000100:00100000:3.0:1788844648.974331:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244812416 00000100:00100000:3.0:1788844648.974391:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 112 00000100:00100000:3.0:1788844648.974401:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:10551:x1875739244812416:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788844648.974435:0:8217:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788844648.974568:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:10551:x1875739244812416:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 167us (5530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844648.974576:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 112 00000100:00100000:0.0:1788844648.984020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844648.984134:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244812544 00000100:00100000:1.0:1788844648.984149:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244812544 00000100:00100000:1.0:1788844648.984245:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 113 00000100:00100000:1.0:1788844648.984259:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:10551:x1875739244812544:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788844648.984372:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9a92 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984398:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984416:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984794:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9a99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984817:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984829:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984867:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984877:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984885:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844648.984942:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788844648.984948:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844648.984965:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984978:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984986:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9a92 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.984994:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9a92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985022:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844648.985028:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9a92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985108:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9a92 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985125:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:1.0:1788844648.985128:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844648.985135:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9a92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985142:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2d9a92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985162:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985169:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9a99 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985176:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9a99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985183:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844648.985186:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9a99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985193:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9a99 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985213:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff91eec7351a00) 00010000:00010000:1.0:1788844648.985216:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844648.985219:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9a99 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985225:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9a99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985249:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985256:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985263:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985269:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844648.985272:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985279:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985286:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:1.0:1788844648.985289:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844648.985292:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844648.985298:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844648.985428:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:10551:x1875739244812544:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 Request processed in 1166us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844648.985439:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 113 00000100:00100000:1.0:1788844648.992050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844648.992155:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244812800 00000100:00100000:0.0:1788844648.992170:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244812800 00000100:00100000:0.0:1788844648.992248:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 114 00000100:00100000:0.0:1788844648.992261:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:10551:x1875739244812800:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788844648.992289:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844648.992316:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031800/0x7f1093851e2d9aa7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fab4 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992453:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9aae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992473:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9aae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992486:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9aae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844648.992500:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788844648.992669:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9aae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992679:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9aae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992700:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9aae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992706:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844648.992740:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9aae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992750:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9aae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992767:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:0.0:1788844648.992770:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788844648.992776:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9aae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992784:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9aae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992838:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031800/0x7f1093851e2d9aa7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fab4 expref: 57 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992851:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:0.0:1788844648.992853:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788844648.992858:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031800/0x7f1093851e2d9aa7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fab4 expref: 57 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844648.992870:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031800, rc 0) 00000100:00100000:0.0:1788844648.992949:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+56:10551:x1875739244812800:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 691us (929us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788844648.992958:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 114 00000100:00100000:1.0:1788844649.017655:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.025409:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244812928 00000100:00100000:3.0:1788844649.025434:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244812928 00000100:00100000:3.0:1788844649.025577:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:3.0:1788844649.025595:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+56:10551:x1875739244812928:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788844649.025644:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788844649.025803:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+56:10551:x1875739244812928:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 215us (8165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.025834:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00080000:0.0:1788844649.026407:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844649.035036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.035237:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244813184 00000100:00100000:3.0:1788844649.035252:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244813184 00000100:00100000:3.0:1788844649.035372:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:3.0:1788844649.035387:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+56:10551:x1875739244813184:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844649.035417:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844649.035421:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788844649.035460:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9a4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa98 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.035495:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844649.035501:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844649.035521:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9abc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fabb expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788844649.036103:0:8217:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788844649.038190:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9ac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.038222:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.038238:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.038337:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205c200/0x7f1093851e2d9abc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fabb expref: 58 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.038395:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fabb expref: 57 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.038406:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eed03a8300) 00010000:00010000:3.0:1788844649.038409:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844649.038413:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844649.041729:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+57:10551:x1875739244813184:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 6324us (6690us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788844649.041747:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:2.0:1788844649.052700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.052874:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244813440 00000100:00100000:3.0:1788844649.052888:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244813440 00000100:00100000:3.0:1788844649.052971:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:3.0:1788844649.052984:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+57:10551:x1875739244813440:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788844649.053097:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844649.053135:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9ac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fabb expref: 57 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053163:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eed03a8300) 00010000:00010000:3.0:1788844649.053177:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844649.053204:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9ad1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053221:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053234:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053316:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9ad8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xce3b063 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053325:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xce3b063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053332:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xce3b063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053424:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053433:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9ad1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053441:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053449:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844649.053454:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053464:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9ad1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053475:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844649.053478:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844649.053482:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9ad1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053490:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9ad1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053510:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xce3b063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053517:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9ad8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xce3b063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053524:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xce3b063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053530:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844649.053579:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xce3b063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053588:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xce3b063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053596:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xce3b063 (ffff91eed03a8e00) 00010000:00010000:3.0:1788844649.053599:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844649.053602:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9ad8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xce3b063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.053609:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9ad8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xce3b063 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844649.053720:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+56:10551:x1875739244813440:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 737us (1045us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788844649.053727:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:2.0:1788844649.061334:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844649.061970:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244813568 00000100:00100000:1.0:1788844649.061986:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244813568 00000100:00100000:1.0:1788844649.062075:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:1.0:1788844649.062088:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+56:10551:x1875739244813568:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788844649.062115:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844649.062147:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9adf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fac2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.062211:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.062229:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.062243:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.062384:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61800/0x7f1093851e2d9adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac2 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.062408:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac2 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.062433:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:1.0:1788844649.062437:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788844649.062442:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60000, rc 0) 00000100:00100000:1.0:1788844649.062831:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+57:10551:x1875739244813568:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 744us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844649.062839:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:0.0:1788844649.067660:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.067857:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244813824 00000100:00100000:3.0:1788844649.067871:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244813824 00000100:00100000:3.0:1788844649.067951:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:3.0:1788844649.067981:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+57:10551:x1875739244813824:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788844649.068093:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.068117:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.068132:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788844649.074050:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1788844649.076013:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a93a0bf4 reply state 00000000cb8cc2e4 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844649.076036:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844649.076208:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+59:10551:x1875739244813824:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 8223us (8558us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788844649.076219:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 119 00010000:00010000:3.0:1788844649.084704:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.084731:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.084741:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.084749:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844649.084755:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.084765:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.084790:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:3.0:1788844649.084794:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788844649.084802:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.084841:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9aed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844649.087847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.088224:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244813952 00000100:00100000:3.0:1788844649.088237:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244813952 00000100:00100000:3.0:1788844649.088324:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:3.0:1788844649.088336:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+58:10551:x1875739244813952:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844649.088372:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844649.088400:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9af4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fac9 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.088499:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac9 expref: 59 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.088518:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac9 expref: 59 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.088628:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:3.0:1788844649.088632:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788844649.088637:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:3.0:1788844649.088939:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+59:10551:x1875739244813952:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 603us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.088948:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:2.0:1788844649.110828:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844649.110955:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244814080 00000100:00100000:0.0:1788844649.110969:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244814080 00000100:00100000:0.0:1788844649.111062:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:0.0:1788844649.111075:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2355:x1875739244814080:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788844649.111211:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788844649.111744:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2355:x1875739244814080:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 668us (927us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788844649.111755:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:2.0:1788844649.120387:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.120571:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244814336 00000100:00100000:3.0:1788844649.120589:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244814336 00000100:00100000:3.0:1788844649.120643:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:3.0:1788844649.120666:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+59:10551:x1875739244814336:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788844649.120921:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:10551:x1875739244814336:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 255us (544us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788844649.120929:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:2.0:1788844649.124926:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844649.125035:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244814592 00000100:00100000:1.0:1788844649.125054:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244814592 00000100:00100000:1.0:1788844649.125113:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:1.0:1788844649.125123:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:10551:x1875739244814592:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788844649.125259:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:10551:x1875739244814592:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 137us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844649.125268:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:2.0:1788844649.130234:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.130967:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244814720 00000100:00100000:3.0:1788844649.130980:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244814720 00000100:00100000:3.0:1788844649.131069:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 122 00000100:00100000:3.0:1788844649.131080:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:10551:x1875739244814720:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844649.131100:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844649.131122:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9afb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fad0 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.131322:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.131339:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.131351:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844649.131390:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844649.131408:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.131432:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9afb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad0 expref: 62 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.131450:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad0 expref: 61 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.131473:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:3.0:1788844649.131476:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788844649.131480:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844649.134491:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:10551:x1875739244814720:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 3401us (4255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.134504:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 122 00000100:00100000:0.0:1788844649.161770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.166123:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244814848 00000100:00100000:3.0:1788844649.166143:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244814848 00000100:00100000:3.0:1788844649.166237:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:3.0:1788844649.166248:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2355:x1875739244814848:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844649.166266:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844649.166287:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d9b09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fad7 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788844649.166315:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9a68, blocks: 0x1 00010000:00010000:3.0:1788844649.166339:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1788844649.166344:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844649.166353:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d9b09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad7 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.166373:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d9b09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad7 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.166386:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024e00, rc 0) 00000100:00100000:3.0:1788844649.166475:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:2355:x1875739244814848:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 228us (4714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.166482:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:2.0:1788844649.177266:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844649.180699:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244815104 00000100:00100000:1.0:1788844649.180719:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244815104 00000100:00100000:1.0:1788844649.180948:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:1.0:1788844649.180960:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:10551:x1875739244815104:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788844649.181113:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:10551:x1875739244815104:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 155us (3857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844649.181122:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 123 00000100:00100000:0.0:1788844649.188170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.188368:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244815232 00000100:00100000:3.0:1788844649.188377:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244815232 00000100:00100000:3.0:1788844649.188436:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:3.0:1788844649.188447:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:10551:x1875739244815232:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844649.188463:0:7066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844649.188481:0:7066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fade expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.188513:0:7066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d9b09 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad7 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.188522:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844649.188527:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844649.188532:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 11 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.188601:0:7066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d9b09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad7 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.188615:0:7066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d9b09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad7 expref: 11 pid: 6687 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844649.188629:0:7066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7066:1875739267898752:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844649.188755:0:7066:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed54facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844649.194571:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844649.194980:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244815360 00000100:00100000:2.0:1788844649.194991:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244815360 00010000:00010000:2.0:1788844649.195056:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d9b09 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad7 expref: 12 pid: 6687 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844649.195103:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:2.0:1788844649.195113:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:2354:x1875739244815360:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844649.195128:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844649.195152:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d9b09 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad7 expref: 12 pid: 6687 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.195166:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d9b09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad7 expref: 12 pid: 6687 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.195226:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844649.195232:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844649.195241:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 12 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.195253:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 12 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.195291:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 12 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844649.195307:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1875739267898880:192.168.204.43@tcp:105: 00000100:00100000:2.0:1788844649.195381:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eefaf009c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788844649.195790:0:7066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc2cb6ae/0x7f1093851e2d9b09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad7 expref: 12 pid: 6687 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844649.195807:0:7066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7066:1875739267898752:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844649.195831:0:7066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 11 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.195843:0:7066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024200, rc 0) 00000100:00100000:3.0:1788844649.195874:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+11:10551:x1875739244815232:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 7428us (7714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.195882:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:2.0:1788844649.202231:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb6d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1875739267898880:192.168.204.43@tcp:105: 00010000:00010000:2.0:1788844649.202258:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844649.202322:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:2354:x1875739244815360:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 7209us (7790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844649.202332:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:0.0:1788844649.210803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844649.210944:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244815488 00000100:00100000:1.0:1788844649.210955:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244815488 00002000:00100000:1.0:1788844649.211024:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91eeff8b2d80 x1875739244815488/t0(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:510/0 lens 504/0 e 0 to 0 dl 1788844660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788844649.211060:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eeff8b2d80 with x1875739244815488 ext(0->12) 00002000:00010000:1.0:1788844649.211066:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eeff8b2d80 00000100:00100000:1.0:1788844649.211100:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:1.0:1788844649.211111:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:2354:x1875739244815488:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788844649.212925:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:2354:x1875739244815488:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 Request processed in 1807us (2122us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788844649.212938:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00002000:00100000:1.0:1788844649.212947:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91eeff8b2d80 x1875739244815488/t4294967308(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:510/0 lens 504/448 e 0 to 0 dl 1788844660 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788844649.212957:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eeff8b2d80 with x1875739244815488 ext(0->12) 00002000:00010000:1.0:1788844649.212963:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eeff8b2d80 00000100:00100000:0.0:1788844649.216722:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844649.217455:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244815616 00000100:00100000:1.0:1788844649.217467:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244815616 00000100:00100000:1.0:1788844649.217530:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 124 00000100:00100000:1.0:1788844649.217577:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:10551:x1875739244815616:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788844649.301773:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:1.0:1788844649.301811:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eeff6a1c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788844649.301817:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eeff366700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eec51c50c0 00000020:00080000:1.0:1788844649.301831:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eeff366500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eec796f400 00000020:00080000:1.0:1788844649.301871:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91edc12f8840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788844649.301875:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eeff366c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91edc12f8480 00000020:00080000:1.0:1788844649.301878:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eeff366100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eef4ee0400 00000020:00080000:2.0:1788844649.301885:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788844649.301908:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000004:00080000:1.0:1788844649.301912:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788844649.301941:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788844649.301964:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788844649.301991:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788844649.302118:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788844649.302123:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267899008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788844649.302384:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:10551:x1875739244815616:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 Request processed in 84842us (85669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.302394:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 124 00000100:00100000:0.0:1788844649.302435:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267899136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788844649.302473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844649.302896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844649.302994:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267899136 00000100:00100000:0.0:1788844649.303002:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267899136 00000100:00100000:0.0:1788844649.303063:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267899008 00000100:00100000:0.0:1788844649.303067:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267899008 00000100:00100000:0.0:1788844649.303091:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788844649.303101:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267899136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788844649.303125:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788844649.303151:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.303170:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2d98d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa3d expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788844649.303284:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788844649.303288:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788844649.303318:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788844649.303323:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788844649.303328:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.303355:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2d98d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa3d expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.303369:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2d98d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa3d expref: 11 pid: 6687 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844649.303381:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875739267899264:192.168.204.43@tcp:104: 00000100:00100000:0.0:1788844649.303436:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844649.303454:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788844649.303462:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267899008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788844649.303475:0:7066:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788844649.303498:0:7066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f9a67, atime: 0x6a9f9a67, ctime: 0x6a9f9a67, blocks: 0x1 00010000:00010000:0.0:1788844649.303504:0:7066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b74e9000/0x7f1093851e2d9b1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.303514:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1788844649.303517:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844649.303522:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b74e9000/0x7f1093851e2d9b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.303570:0:7066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b74e9000/0x7f1093851e2d9b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.303581:0:7066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b74e9000/0x7f1093851e2d9b1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.303590:0:7066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b74e9000/0x7f1093851e2d9b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.303607:0:7066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844649.304988:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844649.304999:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b74e9000/0x7f1093851e2d9b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.305018:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030800 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844649.305023:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b74e9000/0x7f1093851e2d9b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.305033:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b74e9000/0x7f1093851e2d9b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.305053:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b74e9000/0x7f1093851e2d9b1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.305060:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b74e9000/0x7f1093851e2d9b1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.305082:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844649.305084:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844649.305086:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844649.306994:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875739267899008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3524us (4089us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788844649.307005:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788844649.307233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000004:00080000:1.0:1788844649.308129:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eeff31e300/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788844649.308139:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267899008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788844649.308303:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244815744 00000100:00100000:0.0:1788844649.308311:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244815744 00000100:00100000:0.0:1788844649.308362:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:0.0:1788844649.308371:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:2355:x1875739244815744:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788844649.314526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.315006:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244815872 00000100:00100000:3.0:1788844649.315018:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244815872 00010000:00010000:3.0:1788844649.315120:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2d98d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa3d expref: 13 pid: 6687 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844649.315160:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:3.0:1788844649.315170:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2354:x1875739244815872:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844649.315187:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844649.315256:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2d98d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa3d expref: 13 pid: 6687 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.315291:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2d98d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa3d expref: 13 pid: 6687 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.315319:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844649.315325:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844649.315335:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.315347:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.315370:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844649.315422:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2354:x1875739244815872:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 253us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.315430:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 55 00010000:00010000:0.0:1788844649.315581:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2d98d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa3d expref: 12 pid: 6687 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844649.315596:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875739267899264:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844649.315619:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.315640:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.315793:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.315804:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.315813:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.316117:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788844649.316595:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844649.316605:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.316616:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031e00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844649.316621:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.316632:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.316661:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.316668:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dec7081/0x7f1093851e2d9b17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.316696:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844649.316699:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844649.316701:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844649.317310:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875739267899136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14207us (14833us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788844649.317321:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1788844649.317785:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eeff8b0e00/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788844649.317807:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267899136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788844649.381699:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+11:2355:x1875739244815744:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 Request processed in 73320us (74458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844649.381712:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00000001:00080000:0.0:1788844649.381746:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788844649.381757:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1788844649.381775:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1788844649.390958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844649.391065:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244816128 00000100:00100000:0.0:1788844649.391077:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244816128 00000100:00100000:0.0:1788844649.391150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 125 00000100:00100000:0.0:1788844649.391186:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:10551:x1875739244816128:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788844649.391243:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844649.391271:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9b02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fad0 expref: 15 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.391291:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:0.0:1788844649.391296:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788844649.391327:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.391341:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.391351:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788844649.391840:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddff5941 reply state 00000000d18b9f1b transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844649.391852:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788844649.392125:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:10551:x1875739244816128:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 939us (1175us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788844649.392133:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 125 00010000:00010000:2.0:1788844649.404790:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.404809:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.404816:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.404840:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844649.404846:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.404853:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.404870:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:2.0:1788844649.404873:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844649.404877:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.404884:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844649.405715:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844649.405848:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244816256 00000100:00100000:0.0:1788844649.405858:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244816256 00000100:00100000:0.0:1788844649.405915:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:0.0:1788844649.405925:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244816256:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788844649.406132:0:7066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788844649.406136:0:7066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788844648 00002000:00010000:0.0:1788844649.406147:0:7066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788844647 00002000:00010000:0.0:1788844649.406150:0:7066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788844648 -> 1788844648 00002000:00010000:0.0:1788844649.406152:0:7066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788844649.406221:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2357:x1875739244816256:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 296us (510us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788844649.406230:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:2.0:1788844649.413073:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.413145:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244816512 00000100:00100000:3.0:1788844649.413154:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244816512 00000100:00100000:3.0:1788844649.413219:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 126 00000100:00100000:3.0:1788844649.413228:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:10551:x1875739244816512:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788844649.413299:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.413316:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac2 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.413325:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.413359:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac2 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.413373:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac2 expref: 15 pid: 5838 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844649.413405:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267899392:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844649.413530:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed2c6fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788844649.444304:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844649.444415:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244816640 00000100:00100000:0.0:1788844649.444426:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244816640 00010000:00010000:0.0:1788844649.444491:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac2 expref: 16 pid: 5838 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844649.444581:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:0.0:1788844649.444593:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:2354:x1875739244816640:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844649.444610:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844649.444618:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac2 expref: 16 pid: 5838 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.444633:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac2 expref: 16 pid: 5838 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.444660:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:0.0:1788844649.444666:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.444686:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.444694:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.444728:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844649.444778:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:2354:x1875739244816640:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 187us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844649.444786:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 56 00010000:00010000:3.0:1788844649.444996:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2d9ae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac2 expref: 15 pid: 5838 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844649.445016:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267899392:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844649.445038:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.445048:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.445054:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.445086:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.445093:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.445101:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.445107:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844649.445112:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.445132:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.445141:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:3.0:1788844649.445144:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788844649.445148:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.445154:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844649.445214:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10551:x1875739244816512:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 Request processed in 31987us (32152us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788844649.445222:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 126 00000100:00100000:2.0:1788844649.454115:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844649.455905:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244816768 00000100:00100000:0.0:1788844649.455922:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244816768 00000100:00100000:0.0:1788844649.455995:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:0.0:1788844649.456007:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244816768:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788844649.456052:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.456073:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.456083:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844649.456087:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788844649.456092:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.456131:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.456145:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 7 pid: 7066 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844649.456159:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875739267899520:192.168.204.43@tcp:104: 00000100:00100000:0.0:1788844649.456271:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788844649.464106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.464758:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244816896 00000100:00100000:3.0:1788844649.464781:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244816896 00010000:00010000:3.0:1788844649.464823:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 8 pid: 7066 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844649.464866:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:3.0:1788844649.464876:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244816896:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844649.464890:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844649.464917:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 8 pid: 7066 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.464930:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 8 pid: 7066 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.464975:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844649.464980:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844649.464986:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.464997:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.465016:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844649.465096:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244816896:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 221us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.465104:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 57 00010000:00010000:0.0:1788844649.466925:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2d9b10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fade expref: 7 pid: 7066 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844649.466950:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875739267899520:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844649.466986:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.466997:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.467005:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.467053:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.467062:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.467072:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.467079:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844649.467084:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.467117:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.467134:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.467142:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7def8be/0x7f1093851e2d9b33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844649.467285:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244816768:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 Request processed in 11278us (13178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844649.467294:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:2.0:1788844649.490682:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844649.490781:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244817152 00000100:00100000:1.0:1788844649.490794:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244817152 00000100:00100000:1.0:1788844649.490868:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 127 00000100:00100000:1.0:1788844649.490877:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10551:x1875739244817152:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788844649.490951:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2d9b3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.490972:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2d9b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.490983:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2d9b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.491226:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.491238:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9af4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac9 expref: 15 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.491274:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.491886:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac9 expref: 15 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.491904:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9af4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac9 expref: 15 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844649.491921:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267899648:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844649.492070:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67600 going to sleep for 11 seconds 00000100:00100000:1.0:1788844649.506997:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267899648:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844649.507034:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844649.517345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844649.517448:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244817280 00000100:00100000:1.0:1788844649.517459:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244817280 00010000:00010000:1.0:1788844649.517499:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9af4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac9 expref: 16 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844649.517574:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:1.0:1788844649.517585:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+16:2355:x1875739244817280:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844649.517602:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844649.517610:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9af4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac9 expref: 16 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.517645:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac9 expref: 16 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.517681:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9af4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fac9 expref: 16 pid: 8217 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.517702:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:1.0:1788844649.517707:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.517715:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.517723:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844649.517755:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844649.517819:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:2355:x1875739244817280:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 235us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844649.517827:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 58 00010000:00010000:0.0:1788844649.517905:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.517912:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788844649.518103:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788844649.518248:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788844649.518297:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788844649.518382:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1875739267899776:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788844649.518437:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844649.518476:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed54facc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844649.518683:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267899776 00000100:00100000:1.0:1788844649.518690:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267899776 00000100:00100000:1.0:1788844649.519113:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788844649.519125:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875739267899776:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788844649.519209:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875739267899776:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844649.519217:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788844649.519845:0:5840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788844649.519853:0:5840:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1788844649.519882:0:5840:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91eeff8b0e00 x1875739267899136/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788844665 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844649.519896:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1875739267899776:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788844649.520685:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788844649.520757:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1875739267899904:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788844649.521033:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844649.521061:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed54facc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844649.522691:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267899904 00000100:00100000:1.0:1788844649.522705:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267899904 00000100:00100000:1.0:1788844649.522776:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788844649.522786:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875739267899904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788844649.523064:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1875739267899904:12345-0@lo:1000:mdt00_002.0 Request processed in 278us (2031us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788844649.523073:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788844649.523181:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1875739267899904:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788844649.523223:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523235:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523261:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523268:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844649.523272:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523281:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523297:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eec7351a00) 00010000:00010000:2.0:1788844649.523300:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788844649.523326:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523334:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9b41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523366:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523373:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523380:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523385:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205da00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844649.523388:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523404:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523413:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844649.523415:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788844649.523423:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205d400/0x7f1093851e2d9a8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faad expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523583:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205d400/0x7f1093851e2d9a8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faad expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523595:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205d400/0x7f1093851e2d9a8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faad expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.523630:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205d400/0x7f1093851e2d9a8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faad expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844649.523644:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267900032:192.168.204.43@tcp:105: 00000100:00100000:2.0:1788844649.523737:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844649.527095:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267900032:192.168.204.43@tcp:105: 00010000:00010000:0.0:1788844649.527130:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527141:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205da00/0x7f1093851e2d9a84 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527174:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b48 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527188:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527200:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527210:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527216:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b48 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527222:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527243:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844649.527247:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527269:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b48 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527283:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:0.0:1788844649.527286:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844649.527289:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b48 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527295:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b48 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527572:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2d9b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527581:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2d9b3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527587:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2d9b3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527592:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844649.527596:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2d9b3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527602:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2d9b3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527623:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:0.0:1788844649.527626:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788844649.527630:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2d9b3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.527635:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2d9b3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844649.528302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.528386:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244817408 00000100:00100000:3.0:1788844649.528394:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244817408 00000100:00100000:3.0:1788844649.528440:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:3.0:1788844649.528450:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:10550:x1875739244817408:12345-192.168.204.43@tcp:49:lfs.0 00000100:00100000:3.0:1788844649.528651:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:10550:x1875739244817408:12345-192.168.204.43@tcp:49:lfs.0 Request processed in 202us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.528660:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:0.0:1788844649.529041:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:10551:x1875739244817152:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 38163us (38379us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788844649.529051:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 127 00000020:00080000:0.0:1788844649.529055:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788844649.529259:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788844649.529264:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788844649.530905:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788844649.530922:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788844649.539902:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844649.541617:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244817664 00000100:00100000:1.0:1788844649.541634:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244817664 00000100:00100000:1.0:1788844649.541713:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 128 00000100:00100000:1.0:1788844649.541723:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:10550:x1875739244817664:12345-192.168.204.43@tcp:58:lfs.0 00000040:00080000:1.0:1788844649.542102:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788844649.542203:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:10550:x1875739244817664:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 481us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844649.542211:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 128 00000100:00100000:2.0:1788844649.547431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.547933:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244817920 00000100:00100000:3.0:1788844649.547948:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244817920 00000100:00100000:3.0:1788844649.548019:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:3.0:1788844649.548046:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:10551:x1875739244817920:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788844649.548791:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788844649.548912:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788844649.548957:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.548974:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.548984:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.548993:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.549000:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.549005:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.549019:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788844649.549119:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:10551:x1875739244817920:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 1073us (1696us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788844649.549127:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 32 00000020:00080000:3.0:1788844649.549131:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788844649.549528:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844649.549560:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.549569:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844649.549581:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.549590:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.549604:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91eed03a8d00) 00010000:00010000:2.0:1788844649.549606:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788844649.549611:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.549617:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9b4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844649.549636:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844649.549638:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844649.549639:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844649.634649:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844649.634741:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244818048 00000100:00100000:0.0:1788844649.634751:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244818048 00000100:00100000:0.0:1788844649.634822:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 129 00000100:00100000:0.0:1788844649.634832:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:10553:x1875739244818048:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1788844649.634859:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844649.634879:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9b56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fae5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.634942:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9b5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.634956:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9b5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.634965:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9b5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.634997:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.635004:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.635012:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.635234:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.635265:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faa6 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.635274:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.635319:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793faa6 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844649.635335:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793faa6 expref: 21 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844649.635350:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267900160:192.168.204.43@tcp:104: 00000100:00100000:0.0:1788844649.635455:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788844649.645479:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.645606:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244818304 00000100:00100000:3.0:1788844649.645616:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244818304 00000100:00100000:3.0:1788844649.645683:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:3.0:1788844649.645693:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:5597:x1875739244818304:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788844649.645965:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:5597:x1875739244818304:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 272us (494us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788844649.645973:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:2.0:1788844649.649062:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267900160:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844649.649099:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844649.650880:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844649.651005:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244818432 00000100:00100000:3.0:1788844649.651016:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244818432 00010000:00010000:3.0:1788844649.651065:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793faa6 expref: 23 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844649.651106:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:3.0:1788844649.651115:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:2355:x1875739244818432:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844649.651129:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844649.651136:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793faa6 expref: 23 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.651148:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793faa6 expref: 23 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.651178:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2d9a76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793faa6 expref: 23 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.651195:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844649.651200:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.651209:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.651217:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.651256:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844649.651314:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:2355:x1875739244818432:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 198us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.651320:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00010000:00010000:3.0:1788844649.652862:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.652878:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844649.652927:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788844649.652931:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844649.652954:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.652969:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.652979:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9b5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.652985:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9b5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.652993:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9b5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.652999:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844649.653003:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9b5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653029:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9b5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653059:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:3.0:1788844649.653063:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844649.653067:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9b5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653073:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9b5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653087:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653093:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653098:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653104:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844649.653107:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653112:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653119:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91eee1796600) 00010000:00010000:3.0:1788844649.653121:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844649.653124:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653139:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9b64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653190:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9b56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fae5 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653206:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fae5 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844649.653213:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:3.0:1788844649.653215:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844649.653218:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031c00, rc 0) 00000100:00100000:3.0:1788844649.653270:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:10553:x1875739244818048:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 18438us (18630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844649.653278:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 129 00010000:00010000:3.0:1788844649.657756:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788844650.557971:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788844650.557984:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788844650.558076:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788844650.558084:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788844650.558506:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267900288:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788844650.559126:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2dca000 going to sleep for 11 seconds 00000100:00100000:3.0:1788844650.580873:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267900288:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788844650.609874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844650.609923:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244818560 00000100:00100000:3.0:1788844650.609937:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244818560 00000100:00100000:3.0:1788844650.612095:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 130 00000100:00100000:3.0:1788844650.612121:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:10564:x1875739244818560:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788844650.612992:0:8217:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788844650.618763:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:10564:x1875739244818560:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 6634us (8887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844650.618783:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 130 00000100:00100000:1.0:1788844650.629552:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844650.636879:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244818816 00000100:00100000:2.0:1788844650.636902:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244818816 00000100:00100000:2.0:1788844650.636987:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 131 00000100:00100000:2.0:1788844650.639843:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:10564:x1875739244818816:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788844650.639881:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844650.639914:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9b72 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793faec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.646081:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9b79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.646117:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.646134:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844650.646150:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788844650.646336:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9b72 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faec expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.646360:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faec expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.646370:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844650.646374:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788844650.646379:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65e00, rc 0) 00000100:00100000:2.0:1788844650.646481:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:10564:x1875739244818816:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 9472us (16958us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788844650.656345:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 131 00000100:00100000:2.0:1788844650.660410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844650.660465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844650.660519:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244819072 00000100:00100000:2.0:1788844650.660533:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244819072 00000100:00100000:2.0:1788844650.660630:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 132 00000100:00100000:2.0:1788844650.660642:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:10564:x1875739244819072:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788844650.660782:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9b87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.660807:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.660822:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.661105:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.661114:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9b87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.661123:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9b87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.661131:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844650.661136:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9b87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.661145:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9b87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.661159:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844650.661163:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788844650.661168:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9b87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.661174:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9b87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844650.661371:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:10564:x1875739244819072:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 729us (975us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788844650.661380:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 132 00000100:00100000:2.0:1788844650.661415:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244819200 00000100:00100000:2.0:1788844650.661420:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244819200 00000100:00100000:2.0:1788844650.661456:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:2.0:1788844650.661463:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:2357:x1875739244819200:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844650.661478:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844650.661495:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9b79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faec expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844650.661507:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844650.661511:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844650.661531:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:2357:x1875739244819200:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 69us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844650.661567:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000040:00080000:3.0:1788844650.665109:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788844650.665123:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788844650.668932:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000040:00080000:3.0:1788844650.671030:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788844650.671057:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788844650.671201:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244819456 00000100:00100000:3.0:1788844650.671213:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244819456 00000100:00100000:3.0:1788844650.671297:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:3.0:1788844650.671311:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:10564:x1875739244819456:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788844650.671690:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:10564:x1875739244819456:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 382us (2773us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788844650.671699:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00010000:00010000:2.0:1788844650.682769:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788844651.168261:0:12100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788844651.168271:0:12100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788844651.168334:0:12100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788844651.168340:0:12100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788844651.344117:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788844651.344149:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788844651.500290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844651.500327:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244819712 00000100:00100000:2.0:1788844651.500337:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244819712 00000100:00100000:2.0:1788844651.500401:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 133 00000100:00100000:2.0:1788844651.500411:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:10577:x1875739244819712:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844651.500436:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844651.501097:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9b8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793faf3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.501287:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d9b95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.501302:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d9b95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.501315:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d9b95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844651.501327:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788844651.502098:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9b8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faf3 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.502201:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d9b95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faf3 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.502211:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844651.502214:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788844651.502217:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64800, rc 0) 00000100:00100000:2.0:1788844651.502292:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:10577:x1875739244819712:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1881us (2011us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788844651.502300:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 133 00000100:00080000:2.0:1788844651.502338:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844651.516260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844651.516972:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244819840 00000100:00100000:2.0:1788844651.516983:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244819840 00000100:00100000:2.0:1788844651.517035:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 134 00000100:00100000:2.0:1788844651.517044:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:10577:x1875739244819840:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:2.0:1788844651.517125:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9ba3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.517143:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.517153:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.517178:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.517184:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.517190:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.517196:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844651.517201:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.517209:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.517220:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:2.0:1788844651.517223:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788844651.517228:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9ba3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844651.517235:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9ba3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844651.517311:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:10577:x1875739244819840:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 268us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844651.517319:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 134 00000100:00100000:2.0:1788844651.685044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844651.685149:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244819968 00000100:00100000:0.0:1788844651.685159:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244819968 00000100:00100000:0.0:1788844651.685239:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:0.0:1788844651.685250:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244819968:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:0.0:1788844651.685267:0:7066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844651.685288:0:7066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001955aa53/0x7f1093851e2d9baa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fafa expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788844651.685315:0:7066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f9a68, atime: 0x6a9f9a67, ctime: 0x6a9f9a68, blocks: 0xb 00010000:00010000:0.0:1788844651.685333:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1788844651.685338:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844651.685348:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001955aa53/0x7f1093851e2d9baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fafa expref: 7 pid: 7066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844651.685368:0:7066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001955aa53/0x7f1093851e2d9baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fafa expref: 7 pid: 7066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844651.685382:0:7066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031800, rc 0) 00000100:00100000:0.0:1788844651.685443:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244819968:12345-192.168.204.43@tcp:101:cat.0 Request processed in 195us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844651.685451:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00080000:2.0:1788844651.685997:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844651.693026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844651.695382:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244820096 00000100:00100000:1.0:1788844651.695398:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244820096 00002000:00100000:1.0:1788844651.695459:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91eef3171500 x1875739244820096/t0(0) o3->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:512/0 lens 488/0 e 0 to 0 dl 1788844662 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788844651.695471:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eef3171500 with x1875739244820096 ext(0->4095) 00002000:00010000:1.0:1788844651.695491:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eef3171500 00000100:00100000:1.0:1788844651.695573:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:1.0:1788844651.695584:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244820096:12345-192.168.204.43@tcp:3:cat.0 00000100:00100000:1.0:1788844651.695805:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244820096:12345-192.168.204.43@tcp:3:cat.0 Request processed in 222us (2790us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788844651.695812:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00002000:00100000:1.0:1788844651.695819:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91eef3171500 x1875739244820096/t0(0) o3->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:512/0 lens 488/4536 e 0 to 0 dl 1788844662 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788844651.695842:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eef3171500 with x1875739244820096 ext(0->4095) 00002000:00010000:1.0:1788844651.695845:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eef3171500 00010000:00010000:3.0:1788844651.705747:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844652.498290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844652.498359:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844652.498401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844652.498438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844652.498465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844652.498664:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244820736 00000100:00100000:3.0:1788844652.498678:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244820736 00000100:00100000:3.0:1788844652.498759:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244820352 00000100:00100000:3.0:1788844652.498763:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244820352 00000100:00100000:3.0:1788844652.498787:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 155 00000100:00100000:3.0:1788844652.498799:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2356:x1875739244820736:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844652.498894:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2356:x1875739244820736:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 97us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844652.498924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 155 00000100:00100000:3.0:1788844652.498944:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 156 00000100:00100000:3.0:1788844652.498950:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:2356:x1875739244820352:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844652.498991:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:2356:x1875739244820352:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 29us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844652.498997:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 156 00000100:00100000:2.0:1788844652.499229:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244820480 00000100:00100000:2.0:1788844652.499235:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244820480 00000100:00100000:2.0:1788844652.499274:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244820608 00000100:00100000:2.0:1788844652.499277:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244820608 00000100:00100000:2.0:1788844652.499302:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:2.0:1788844652.499309:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2356:x1875739244820480:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844652.499342:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2356:x1875739244820480:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 34us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844652.499349:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:2.0:1788844652.499362:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:2.0:1788844652.499367:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2356:x1875739244820608:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844652.499388:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2356:x1875739244820608:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 21us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844652.499394:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:0.0:1788844652.500163:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244820224 00000100:00100000:0.0:1788844652.500171:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244820224 00000100:00100000:0.0:1788844652.500220:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 297 00000100:00100000:0.0:1788844652.500229:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2356:x1875739244820224:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844652.500277:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2356:x1875739244820224:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 50us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844652.500296:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 297 00000100:00080000:1.0:1788844652.500679:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788844652.500686:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788844652.730493:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844652.795794:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267900416:0@lo:400:kworker.0 00000100:00100000:3.0:1788844652.795802:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267900800:0@lo:400:kworker.0 00000100:00100000:2.0:1788844652.797362:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267900672:0@lo:400:kworker.0 00000100:00100000:1.0:1788844652.801555:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844652.801659:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed05fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267900928:0@lo:400:kworker.0 00000100:00100000:1.0:1788844652.801707:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844652.801829:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844652.801855:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788844652.801862:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267900544:0@lo:400:kworker.0 00000100:00100000:2.0:1788844652.801904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844652.801922:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267901056:0@lo:400:kworker.0 00000100:00100000:2.0:1788844652.801946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844652.801976:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267900928 00000100:00100000:2.0:1788844652.801984:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267900928 00000100:00100000:2.0:1788844652.802037:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267900672 00000100:00100000:2.0:1788844652.802040:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267900672 00000100:00100000:2.0:1788844652.802053:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267900544 00000100:00100000:2.0:1788844652.802055:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267900544 00000100:00100000:2.0:1788844652.802069:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788844652.802077:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267900928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844652.802190:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788844652.802199:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267900672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844652.802251:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267900672:12345-0@lo:400:kworker.0 Request processed in 54us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844652.802258:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788844652.802276:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788844652.802281:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267900544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844652.802305:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267900544:12345-0@lo:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844652.802310:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788844652.802512:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267900544:0@lo:400:kworker.0 00000100:00100000:3.0:1788844652.802525:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267900672:0@lo:400:kworker.0 00000100:00100000:3.0:1788844652.802573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844652.802598:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267901056 00000100:00100000:3.0:1788844652.802602:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267901056 00000100:00100000:3.0:1788844652.802649:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267900800 00000100:00100000:3.0:1788844652.802659:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267900800 00000100:00100000:3.0:1788844652.802682:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788844652.802687:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267901056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844652.802721:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267901056:12345-0@lo:400:kworker.0 Request processed in 33us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844652.802726:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788844652.802737:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788844652.802743:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875739267900800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844652.802769:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875739267900800:12345-0@lo:400:kworker.0 Request processed in 26us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844652.802774:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788844652.802909:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267900928:12345-0@lo:400:kworker.0 Request processed in 832us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844652.802916:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1788844652.802939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788844652.802943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788844652.802945:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844652.802965:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed05fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267900928:0@lo:400:kworker.0 00000100:00100000:1.0:1788844652.803031:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267900416 00000100:00100000:1.0:1788844652.803036:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267900416 00000100:00100000:1.0:1788844652.803070:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788844652.803076:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267900416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844652.803187:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3308:x1875739267900416:12345-0@lo:400:kworker.0 Request processed in 112us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844652.803193:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788844652.803277:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3308:1875739267900416:0@lo:400:kworker.0 00000100:00100000:2.0:1788844652.803646:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267900800:0@lo:400:kworker.0 00000100:00100000:3.0:1788844652.803700:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788844652.803707:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788844652.803721:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eeff31e300, transno 4294967304 00000100:00100000:3.0:1788844652.803774:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267901056:0@lo:400:kworker.0 00000100:00100000:3.0:1788844653.305839:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff2bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267901184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844653.305904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844653.306013:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267901184 00000100:00100000:1.0:1788844653.306021:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267901184 00000100:00100000:1.0:1788844653.306068:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788844653.306077:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267901184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844653.306117:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844653.306160:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267901184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844653.306167:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788844653.306355:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff2bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267901184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788844653.753983:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788844653.818029:0:7026:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368096488778ns, next at 369096486442ns, rc = 0 00000100:00100000:3.0:1788844653.818096:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844653.818117:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed05fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267901312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844653.818193:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844653.818568:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267901312 00000100:00100000:0.0:1788844653.818578:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267901312 00000100:00100000:0.0:1788844653.818648:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788844653.818658:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875739267901312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788844653.818695:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844653.818745:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875739267901312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844653.818752:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788844653.818925:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed05fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267901312:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788844654.411785:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:1.0:1788844654.411808:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91edc12f8d80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788844654.411815:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eec2cffc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91edc12f8480 00000020:00080000:1.0:1788844654.411818:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eec2cfff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eeeffd6400 00000004:00080000:1.0:1788844654.411869:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:1.0:1788844654.411883:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788844654.411895:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788844654.411962:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788844654.412210:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1788844654.412315:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788844654.412343:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267901440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788844654.412441:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844654.412587:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267901440 00000100:00100000:3.0:1788844654.412598:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267901440 00000100:00100000:3.0:1788844654.412666:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788844654.412676:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875739267901440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788844654.412914:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788844654.412919:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788844648 -> 1788844648 00002000:00010000:3.0:1788844654.412921:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788844647 -> 1788844647 00002000:00010000:3.0:1788844654.412924:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788844648 -> 1788844648 00002000:00010000:3.0:1788844654.412926:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788844654.412977:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3307:x1875739267901440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 301us (536us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788844654.412985:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:3.0:1788844654.413039:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eeff1a3480/2, rc 0, transno 4294967312 00000100:00100000:3.0:1788844654.413046:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267901440:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788844654.413283:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788844654.477424:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788844654.477448:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788844654.477461:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000040:00080000:0.0:1788844654.777879:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788844654.777895:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788844654.777943:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788844654.777952:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788844654.778299:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844655.806733:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844656.827797:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844657.609360:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844657.609428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844657.609465:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844657.609487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844657.609529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844657.609580:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244821376 00000100:00100000:1.0:1788844657.609600:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244821376 00000100:00100000:1.0:1788844657.609683:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244820992 00000100:00100000:1.0:1788844657.609687:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244820992 00000100:00100000:1.0:1788844657.609715:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 160 00000100:00100000:1.0:1788844657.609726:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244821376:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844657.609838:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244821376:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 113us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844657.609847:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 160 00000100:00100000:1.0:1788844657.609866:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 161 00000100:00100000:1.0:1788844657.609873:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2354:x1875739244820992:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844657.609901:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2354:x1875739244820992:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844657.609907:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 161 00000100:00100000:1.0:1788844657.609928:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244821120 00000100:00100000:1.0:1788844657.609931:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244821120 00000100:00100000:1.0:1788844657.609957:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244821248 00000100:00100000:1.0:1788844657.609960:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244821248 00000100:00100000:1.0:1788844657.609984:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:1.0:1788844657.609991:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244821120:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844657.610021:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244821120:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844657.610027:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:1.0:1788844657.610039:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 89 00000100:00100000:1.0:1788844657.610045:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244821248:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844657.610068:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244821248:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844657.610079:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 89 00000100:00080000:1.0:1788844657.610095:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788844657.610100:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788844657.610102:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844657.616534:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244820864 00000100:00100000:3.0:1788844657.616595:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244820864 00000100:00100000:3.0:1788844657.616683:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 299 00000100:00100000:3.0:1788844657.616696:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244820864:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844657.616819:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244820864:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 124us (7473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844657.616828:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 299 00010000:00010000:0.0:1788844657.855383:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844657.918109:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267901568:0@lo:400:kworker.0 00000100:00100000:0.0:1788844657.918109:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267901824:0@lo:400:kworker.0 00000100:00100000:3.0:1788844657.919630:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267901696:0@lo:400:kworker.0 00000100:00100000:1.0:1788844657.923732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844657.924247:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267901568 00000100:00100000:1.0:1788844657.924259:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267901568 00000100:00100000:1.0:1788844657.924339:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788844657.924353:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267901568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844657.924428:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267901568:12345-0@lo:400:kworker.0 Request processed in 77us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844657.924436:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788844657.925225:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267901568:0@lo:400:kworker.0 00000100:00100000:1.0:1788844657.925243:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267902080:0@lo:400:kworker.0 00000100:00100000:1.0:1788844657.925296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844657.925335:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267902080 00000100:00100000:1.0:1788844657.925339:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267902080 00000100:00100000:1.0:1788844657.925390:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788844657.925397:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267902080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844657.928273:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844657.928357:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844657.928374:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267901952:0@lo:400:kworker.0 00000100:00100000:0.0:1788844657.928427:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844657.928486:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267901952 00000100:00100000:0.0:1788844657.928496:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267901952 00000100:00100000:0.0:1788844657.928595:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788844657.928607:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267901952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844657.928671:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267901952:12345-0@lo:400:kworker.0 Request processed in 66us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844657.928680:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788844657.928755:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788844657.928762:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eeff8b0e00, transno 4294967309 00000004:00080000:0.0:1788844657.928777:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1788844657.928817:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91eeff1a3480 x1875739267901440/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788844670 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844657.928831:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267901952:0@lo:400:kworker.0 00000100:00100000:2.0:1788844657.929337:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267901824 00000100:00100000:2.0:1788844657.929352:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267901824 00000100:00100000:2.0:1788844657.929396:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788844657.929404:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267901824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844657.929466:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267901824:12345-0@lo:400:kworker.0 Request processed in 63us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844657.929473:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788844657.932819:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267901824:0@lo:400:kworker.0 00000100:00080000:0.0:1788844657.933297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844657.933306:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844657.936881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844657.936972:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267902208:0@lo:400:kworker.0 00000100:00100000:3.0:1788844657.937029:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844657.937231:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267901696 00000100:00100000:0.0:1788844657.937243:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267901696 00000100:00100000:0.0:1788844657.937309:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788844657.937319:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267901696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844657.937388:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267901696:12345-0@lo:400:kworker.0 Request processed in 70us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844657.937396:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788844657.938244:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267902208 00000100:00100000:3.0:1788844657.938256:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267902208 00000100:00100000:3.0:1788844657.938334:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788844657.938343:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267902208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844657.938409:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267902208:12345-0@lo:400:kworker.0 Request processed in 67us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844657.938416:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788844657.938479:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267902208:0@lo:400:kworker.0 00000100:00100000:3.0:1788844657.938531:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267901696:0@lo:400:kworker.0 00000100:00080000:0.0:1788844657.940920:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788844657.943647:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267902080:0@lo:400:kworker.0 00000100:00100000:1.0:1788844657.944116:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267902080:12345-0@lo:400:kworker.0 Request processed in 18713us (18813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844657.944142:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788844658.427464:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788844658.427508:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267902336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844658.427627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844658.427726:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267902336 00000100:00100000:0.0:1788844658.427737:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267902336 00000100:00100000:0.0:1788844658.427858:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788844658.427870:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267902336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788844658.429123:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844658.430509:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267902336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2621us (2863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844658.430527:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788844658.432855:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267902336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788844658.876642:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844658.940563:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267902464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844658.940677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844658.940952:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267902464 00000100:00100000:0.0:1788844658.940964:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267902464 00000100:00100000:0.0:1788844658.941047:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788844658.941069:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875739267902464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788844658.941120:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844658.941180:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875739267902464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844658.941188:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788844658.941397:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267902464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844659.099917:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844659.099997:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244821504 00000100:00100000:0.0:1788844659.100012:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244821504 00000100:00100000:0.0:1788844659.100112:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 135 00000100:00100000:0.0:1788844659.100125:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:10229:x1875739244821504:12345-192.168.204.43@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788844659.100280:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:10229:x1875739244821504:12345-192.168.204.43@tcp:60:lhsmtool_posix.0 Request processed in 157us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844659.100289:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 135 00000100:00080000:1.0:1788844659.100846:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844659.117608:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844659.117734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244821760 00000100:00100000:1.0:1788844659.117749:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244821760 00000100:00100000:1.0:1788844659.117826:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:1.0:1788844659.117839:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:10229:x1875739244821760:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788844659.118297:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:10229:x1875739244821760:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 458us (702us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788844659.118306:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000001:00080000:3.0:1788844659.590081:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788844659.662848:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788844659.662989:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788844659.663110:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788844659.663126:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788844659.749022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844659.749267:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244821888 00000100:00100000:0.0:1788844659.749281:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244821888 00000100:00100000:0.0:1788844659.749387:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 136 00000100:00100000:0.0:1788844659.749400:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:11032:x1875739244821888:12345-192.168.204.43@tcp:101:lsof.0 00010000:00010000:0.0:1788844659.749426:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844659.749452:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb01 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844659.749642:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844659.749659:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844659.749675:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844659.749722:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788844659.749727:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788844659.749779:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844659.749809:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb01 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844659.749833:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb01 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844659.749853:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:0.0:1788844659.749856:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788844659.749861:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031e00, rc 0) 00000100:00100000:0.0:1788844659.749929:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+6:11032:x1875739244821888:12345-192.168.204.43@tcp:101:lsof.0 Request processed in 532us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844659.749937:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 136 00000100:00080000:1.0:1788844659.750179:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788844659.898450:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844660.921883:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844661.945876:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844662.730740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844662.730802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844662.730838:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844662.730874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844662.731084:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244822144 00000100:00100000:0.0:1788844662.731097:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244822144 00000100:00100000:3.0:1788844662.731132:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244822400 00000100:00100000:3.0:1788844662.731138:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244822400 00000100:00100000:3.0:1788844662.731182:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244822272 00000100:00100000:3.0:1788844662.731185:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244822272 00000100:00100000:0.0:1788844662.731185:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 165 00000100:00100000:0.0:1788844662.731196:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2356:x1875739244822144:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844662.731207:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 92 00000100:00100000:3.0:1788844662.731214:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2356:x1875739244822400:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844662.731315:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244822016 00000100:00100000:1.0:1788844662.731321:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244822016 00000100:00100000:1.0:1788844662.731359:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 301 00000100:00100000:1.0:1788844662.731366:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244822016:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844662.731449:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2356:x1875739244822144:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 253us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844662.731473:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 165 00000100:00100000:0.0:1788844662.731505:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:0.0:1788844662.731513:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2356:x1875739244822272:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844662.735894:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2356:x1875739244822400:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 4658us (5032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844662.736037:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 92 00000100:00080000:3.0:1788844662.736304:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788844662.736313:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788844662.736318:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844662.738617:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244822016:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 7230us (7876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844662.738638:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 301 00000100:00100000:0.0:1788844662.739844:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2356:x1875739244822272:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 8315us (8952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844662.739864:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:2.0:1788844662.739992:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844662.740351:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244822528 00000100:00100000:0.0:1788844662.740363:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244822528 00000100:00100000:0.0:1788844662.740507:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 166 00000100:00100000:0.0:1788844662.740519:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+6:2356:x1875739244822528:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844662.747937:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+6:2356:x1875739244822528:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 7382us (7910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844662.747971:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 166 00000100:00080000:1.0:1788844662.752684:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788844662.970037:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844663.036030:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267902720:0@lo:400:kworker.0 00000100:00100000:1.0:1788844663.036137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844663.036163:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267902720 00000100:00100000:0.0:1788844663.036172:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267902720 00000100:00100000:1.0:1788844663.036226:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788844663.036233:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267902592:0@lo:400:kworker.0 00000100:00100000:1.0:1788844663.036295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844663.044430:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267902976:0@lo:400:kworker.0 00000100:00100000:3.0:1788844663.044554:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267902848:0@lo:400:kworker.0 00000100:00100000:1.0:1788844663.044561:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844663.044612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844663.045070:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267903232:0@lo:400:kworker.0 00000100:00100000:1.0:1788844663.045109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844663.045139:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788844663.045147:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267903104:0@lo:400:kworker.0 00000100:00100000:1.0:1788844663.049961:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267902976 00000100:00100000:1.0:1788844663.049996:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267902976 00000100:00100000:1.0:1788844663.050112:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267903232 00000100:00100000:1.0:1788844663.050117:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267903232 00000100:00100000:1.0:1788844663.050156:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788844663.050170:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267902976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844663.051893:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788844663.053029:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267902848 00000100:00100000:0.0:1788844663.053049:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267902848 00000100:00100000:0.0:1788844663.053366:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788844663.053385:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267902720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844663.054531:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267903232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844663.055154:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788844663.055159:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267902976:12345-0@lo:400:kworker.0 Request processed in 4992us (10597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844663.055171:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788844663.055176:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267902848:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788844663.055211:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788844663.055218:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788844663.055221:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267902848:12345-0@lo:400:kworker.0 Request processed in 58us (10609us total) trans 0 rc 0/0 00000100:00080000:1.0:1788844663.055222:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844663.055227:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788844663.055254:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267902592 00000100:00100000:2.0:1788844663.055260:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267902592 00000100:00100000:1.0:1788844663.055263:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788844663.055269:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eeff1a3480, transno 4294967312 00000100:00100000:1.0:1788844663.055288:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267902976:0@lo:400:kworker.0 00000100:00100000:2.0:1788844663.055312:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788844663.055319:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267902592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844663.055353:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267902592:12345-0@lo:400:kworker.0 Request processed in 35us (19058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844663.055359:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788844663.055610:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267902848:0@lo:400:kworker.0 00000100:00100000:2.0:1788844663.055668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844663.055703:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267902592:0@lo:400:kworker.0 00000100:00100000:2.0:1788844663.055729:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267902720:0@lo:400:kworker.0 00000100:00100000:2.0:1788844663.055747:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267903104 00000100:00100000:2.0:1788844663.055750:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267903104 00000100:00100000:2.0:1788844663.055782:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788844663.055788:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267903104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844663.055825:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267903104:12345-0@lo:400:kworker.0 Request processed in 36us (157us total) trans 0 rc 0/0 00000100:00080000:1.0:1788844663.055826:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844663.055832:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788844663.055856:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267903104:0@lo:400:kworker.0 00000100:00100000:0.0:1788844663.067834:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267902720:12345-0@lo:400:kworker.0 Request processed in 14441us (31680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844663.067854:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788844663.077635:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267903232:12345-0@lo:400:kworker.0 Request processed in 23165us (32512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844663.077653:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788844663.077655:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267903232:0@lo:400:kworker.0 00000100:00100000:2.0:1788844663.547373:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267903360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844663.547504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844663.547761:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267903360 00000100:00100000:3.0:1788844663.547772:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267903360 00000100:00100000:3.0:1788844663.547849:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788844663.547860:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267903360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844663.547927:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844663.547996:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267903360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844663.548004:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788844663.548622:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267903360:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788844663.997335:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844664.059865:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267903488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844664.059992:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844664.061043:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267903488 00000100:00100000:0.0:1788844664.061060:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267903488 00000100:00100000:0.0:1788844664.061154:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788844664.061167:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267903488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788844664.061224:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844664.061326:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267903488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844664.061334:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788844664.062043:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267903488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788844665.017769:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788844665.019524:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788844665.019557:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788844665.020703:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788844665.020715:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788844666.041789:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788844666.322115:0:12301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:17:43 (1788844663) 00010000:00010000:0.0:1788844667.066045:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844667.838428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844667.838599:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244822784 00000100:00100000:0.0:1788844667.838612:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244822784 00000100:00080000:1.0:1788844667.838838:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844667.839110:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 137 00000100:00100000:0.0:1788844667.839136:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:11298:x1875739244822784:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788844667.839178:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844667.839208:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9bbf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb08 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.839461:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9bc6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.839496:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.839514:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.839534:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9bcd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.839582:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9bcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.839589:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9bcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.842376:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9bd4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.842408:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.842422:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844667.842440:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788844667.842713:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.842722:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9bc6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.842730:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.842873:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844667.842879:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.842887:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.842905:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eec2f43600) 00010000:00010000:0.0:1788844667.842908:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844667.842913:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9bc6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.842920:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9bc6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.843057:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9bcd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.843064:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9bcd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.843071:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9bcd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.843077:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844667.843080:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9bcd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.843086:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9bcd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.843106:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91eee1796900) 00010000:00010000:0.0:1788844667.843109:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844667.843112:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9bcd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.843129:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9bcd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.847090:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9bbf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb08 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844667.847249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:0.0:1788844667.847295:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb08 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844667.847308:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:0.0:1788844667.847311:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844667.847326:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030600, rc 0) 00000100:00100000:3.0:1788844667.847387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844667.847410:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:11298:x1875739244822784:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 8280us (8998us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788844667.847421:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 137 00000100:00100000:2.0:1788844667.848016:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244823040 00000100:00100000:2.0:1788844667.848030:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244823040 00000100:00080000:0.0:1788844667.848088:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844667.848131:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 96 00000100:00100000:2.0:1788844667.848143:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244823040:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844667.848205:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244823040:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 65us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844667.848234:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 96 00000100:00100000:1.0:1788844667.849378:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244822912 00000100:00100000:1.0:1788844667.849408:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244822912 00000100:00100000:1.0:1788844667.849480:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 303 00000100:00100000:1.0:1788844667.849491:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2355:x1875739244822912:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844667.849605:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2355:x1875739244822912:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 116us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844667.849613:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 303 00000100:00100000:0.0:1788844667.851685:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844667.851770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844667.851848:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244823296 00000100:00100000:2.0:1788844667.851860:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244823296 00000100:00100000:2.0:1788844667.851941:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:2.0:1788844667.851952:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:2356:x1875739244823296:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844667.851973:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844667.852010:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9bd4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb08 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844667.852036:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:2.0:1788844667.852043:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844667.852118:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:2356:x1875739244823296:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 168us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844667.852126:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:3.0:1788844667.852585:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244823424 00000100:00100000:3.0:1788844667.852592:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244823424 00000100:00100000:3.0:1788844667.852643:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 138 00000100:00100000:3.0:1788844667.852651:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:11298:x1875739244823424:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788844667.852756:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:11298:x1875739244823424:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 Request processed in 105us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844667.852785:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 138 00000100:00100000:0.0:1788844667.857594:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844667.857907:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244823168 00000100:00100000:2.0:1788844667.857930:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244823168 00000100:00100000:2.0:1788844667.858022:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:2.0:1788844667.858035:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2353:x1875739244823168:12345-192.168.204.43@tcp:9:kworker.0 00000020:00000080:2.0:1788844667.858091:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d95a6 00000100:00080000:2.0:1788844667.858103:0:6687:0:(import.c:65:import_set_state_nolock()) ffff91eed2c32000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788844667.858161:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967304 00000100:00100000:2.0:1788844667.858532:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+2:2353:x1875739244823168:12345-192.168.204.43@tcp:9:kworker.0 Request processed in 498us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844667.858571:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00010000:00010000:1.0:1788844667.858709:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788844667.862821:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788844667.863804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844667.863910:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244823552 00000100:00100000:1.0:1788844667.863934:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244823552 00000100:00100000:1.0:1788844667.864025:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 170 00000100:00100000:1.0:1788844667.864038:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+6:2354:x1875739244823552:12345-192.168.204.43@tcp:400:kworker.0 00000100:00080000:0.0:1788844667.864214:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844667.864521:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+6:2354:x1875739244823552:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 484us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844667.864532:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 170 00010000:00010000:0.0:1788844668.090091:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788844668.093129:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788844668.093530:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788844668.098276:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788844668.098307:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788844668.154792:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267903616:0@lo:400:kworker.0 00000100:00100000:0.0:1788844668.154910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844668.155021:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267903616 00000100:00100000:1.0:1788844668.155032:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267903616 00000100:00100000:1.0:1788844668.155096:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788844668.155107:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267903616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.161923:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267903744:0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.162025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844668.162067:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267904256:0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.162097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844668.162131:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788844668.162137:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267904128:0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.162162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844668.162193:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267903872:0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.162219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844668.162239:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788844668.162245:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267904000:0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.162270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844668.162332:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267904256 00000100:00100000:3.0:1788844668.162351:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267904256 00000100:00100000:1.0:1788844668.163450:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267903616:12345-0@lo:400:kworker.0 Request processed in 8335us (8530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844668.163467:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788844668.163710:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267904000 00000100:00100000:1.0:1788844668.163720:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267904000 00000100:00100000:1.0:1788844668.163776:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788844668.163786:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267904256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.163854:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788844668.163864:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267904000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844668.163879:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267904256:12345-0@lo:400:kworker.0 Request processed in 95us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844668.163886:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788844668.163905:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267904000:12345-0@lo:400:kworker.0 Request processed in 43us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844668.163910:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788844668.163931:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267903744 00000100:00100000:3.0:1788844668.163936:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267903744 00000100:00100000:3.0:1788844668.163971:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267904128 00000100:00100000:3.0:1788844668.163974:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267904128 00000100:00100000:3.0:1788844668.163991:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267903872 00000100:00100000:3.0:1788844668.163993:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267903872 00000100:00100000:3.0:1788844668.164019:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788844668.164025:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267903744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.164061:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267903744:12345-0@lo:400:kworker.0 Request processed in 36us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844668.171328:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267903616:0@lo:400:kworker.0 00000100:00080000:0.0:1788844668.172331:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788844668.172340:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844668.172343:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788844668.172433:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788844668.172457:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267904128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844668.172596:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267904128:12345-0@lo:400:kworker.0 Request processed in 150us (10432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844668.172605:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788844668.172637:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788844668.172645:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267903872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.173984:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788844668.174451:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267904000:0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.174505:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267904128:0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.174521:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267903744:0@lo:400:kworker.0 00000100:00100000:3.0:1788844668.174561:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267904256:0@lo:400:kworker.0 00000100:00100000:1.0:1788844668.175365:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267903872:12345-0@lo:400:kworker.0 Request processed in 2716us (13140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844668.175378:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788844668.176369:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267903872:0@lo:400:kworker.0 00000100:00100000:1.0:1788844668.666143:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788844668.666178:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267904384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844668.666271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844668.666368:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267904384 00000100:00100000:1.0:1788844668.666379:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267904384 00000100:00100000:1.0:1788844668.666442:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788844668.666454:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267904384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844668.666502:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844668.666588:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267904384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844668.666596:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788844668.668939:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267904384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788844669.129222:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844669.178066:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267904512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844669.178170:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844669.178673:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267904512 00000100:00100000:0.0:1788844669.178685:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267904512 00000100:00100000:0.0:1788844669.178757:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788844669.178770:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267904512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788844669.180012:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844669.180138:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267904512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1367us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844669.180148:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788844669.180320:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267904512:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788844669.852748:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1788844670.137693:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844671.165174:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844671.450365:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844671.456408:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244823680 00000100:00100000:3.0:1788844671.456432:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244823680 00000100:00100000:3.0:1788844671.456764:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 139 00000100:00100000:3.0:1788844671.456782:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:11341:x1875739244823680:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844671.456812:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844671.456840:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9be2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb0f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457085:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9be9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457103:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9be9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457116:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9be9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457154:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9bf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457163:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457171:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457494:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9be9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457503:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9be9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457511:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9be9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457518:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844671.457524:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9be9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457667:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9be9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457685:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:3.0:1788844671.457688:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844671.457694:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9be9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457700:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9be9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457721:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457726:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9bf0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457732:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457830:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844671.457833:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457839:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457846:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91eed03a8400) 00010000:00010000:3.0:1788844671.457849:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844671.457852:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9bf0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457857:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9bf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457952:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9be2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb0f expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457964:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:3.0:1788844671.457967:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844671.457977:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb0f expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.457987:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025600, rc 0) 00000100:00100000:3.0:1788844671.458155:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:11341:x1875739244823680:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1380us (7805us total) trans 0 rc 301/301 00000100:00100000:3.0:1788844671.458164:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 139 00000100:00080000:1.0:1788844671.460572:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844671.483262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844671.483460:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244823936 00000100:00100000:3.0:1788844671.483475:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244823936 00000100:00100000:3.0:1788844671.483575:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 140 00000100:00100000:3.0:1788844671.483587:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:11341:x1875739244823936:12345-192.168.204.43@tcp:36:lfs.0 00010000:00010000:3.0:1788844671.483859:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844671.484577:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed99ba400/0x7f1093851e2d9560 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f948 expref: 13 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.484607:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:3.0:1788844671.485956:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844671.487368:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.487399:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb01 expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.487409:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.487459:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb01 expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.487493:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb01 expref: 5 pid: 5838 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844671.487513:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec31fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267904640:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844671.491935:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eede895c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788844671.505434:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844671.505688:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244824064 00000100:00100000:2.0:1788844671.505702:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244824064 00010000:00010000:2.0:1788844671.505787:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb01 expref: 6 pid: 5838 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844671.505834:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:2.0:1788844671.505844:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89582201-bdf6-4401-b202-b9313c368ae5+6:2355:x1875739244824064:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844671.505863:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844671.505871:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb01 expref: 6 pid: 5838 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.505885:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb01 expref: 6 pid: 5838 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.505924:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:2.0:1788844671.505931:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.505942:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.505951:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.505975:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844671.506041:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89582201-bdf6-4401-b202-b9313c368ae5+6:2355:x1875739244824064:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 198us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844671.506069:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00080000:3.0:1788844671.508673:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788844671.512111:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9bb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb01 expref: 5 pid: 5838 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844671.512146:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec31fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267904640:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844671.512178:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.512192:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.512199:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.512258:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.512791:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.512804:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844671.518966:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788844671.518990:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.519001:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.519009:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.519015:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844671.519019:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.519028:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.519045:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:0.0:1788844671.519048:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844671.519053:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.519059:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9bf7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788844671.519093:0:8217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b21f9f8b reply state 000000003821a34a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844671.519102:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788844671.519225:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:11341:x1875739244823936:12345-192.168.204.43@tcp:36:lfs.0 Request processed in 35635us (35983us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788844671.519235:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 140 00010000:00010000:2.0:1788844671.525024:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.525049:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.525058:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.525066:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844671.525072:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.525080:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.525103:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91eee1796200) 00010000:00010000:2.0:1788844671.525106:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844671.525112:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.525119:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9bfe lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844671.709651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844671.709767:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244824192 00000100:00100000:0.0:1788844671.709777:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244824192 00000100:00100000:0.0:1788844671.709842:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 141 00000100:00100000:0.0:1788844671.709862:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:11349:x1875739244824192:12345-192.168.204.43@tcp:101:lctl.0 00010000:00010000:0.0:1788844671.709887:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844671.709910:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9c05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb16 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.709976:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9c0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.709990:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.710002:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844671.710052:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788844671.710056:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788844671.710079:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.710123:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9c05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb16 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.710141:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb16 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.710149:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:0.0:1788844671.710152:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788844671.710156:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030800, rc 0) 00000100:00100000:0.0:1788844671.710216:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:11349:x1875739244824192:12345-192.168.204.43@tcp:101:lctl.0 Request processed in 357us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844671.710222:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 141 00000100:00100000:0.0:1788844671.843165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844671.843290:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244824320 00000100:00100000:2.0:1788844671.843300:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244824320 00000100:00100000:2.0:1788844671.843358:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 142 00000100:00100000:2.0:1788844671.843368:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:11355:x1875739244824320:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1788844671.843396:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844671.843419:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9c13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb1d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.843483:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9c1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.843499:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9c1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.843511:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9c1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.843524:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9c21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.843531:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9c21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.843567:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9c21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.846906:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9c28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.846929:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.846941:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844671.846980:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788844671.846994:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844671.847019:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847033:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9c1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847040:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9c1a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847047:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9c1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847053:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844671.847057:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9c1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847065:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9c1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847079:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:2.0:1788844671.847082:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844671.847087:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9c1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847093:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9c1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847106:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9c21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847111:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9c21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847126:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9c21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847132:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844671.847135:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9c21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847141:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9c21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847148:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91eec2f43500) 00010000:00010000:2.0:1788844671.847151:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844671.847153:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9c21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847158:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9c21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847200:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb1d expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847213:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb1d expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.847221:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:2.0:1788844671.847223:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788844671.847226:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64200, rc 0) 00000100:00100000:2.0:1788844671.847310:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:11355:x1875739244824320:12345-192.168.204.43@tcp:101:bash.0 Request processed in 3941us (4152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844671.847327:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 142 00000100:00100000:3.0:1788844671.857720:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844671.857765:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244824576 00000100:00100000:3.0:1788844671.857775:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244824576 00000100:00100000:3.0:1788844671.857842:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 143 00000100:00100000:3.0:1788844671.857851:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+15:11355:x1875739244824576:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844671.857873:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844671.857896:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9c2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb24 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.858023:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9c36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.858037:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9c36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.858048:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9c36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.858138:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.858166:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.858173:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788844671.858767:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788844671.858930:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.858940:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.858948:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.858985:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9c36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.858994:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9c36 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.859000:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9c36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.859006:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844671.859010:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9c36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.859019:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9c36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.859042:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844671.859045:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844671.859050:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9c36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.859057:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9c36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788844671.859071:0:5840:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f423587 reply state 00000000ed1928ee transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844671.859079:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788844671.859112:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9c2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb24 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.859127:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb24 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.859135:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8400) 00010000:00010000:3.0:1788844671.859137:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844671.859140:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024200, rc 0) 00000100:00100000:3.0:1788844671.859211:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:11355:x1875739244824576:12345-192.168.204.43@tcp:101:bash.0 Request processed in 1360us (1501us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788844671.859219:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 143 00010000:00010000:3.0:1788844671.866509:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.866528:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.866568:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.866575:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844671.866580:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.866589:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.866605:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eed03a8f00) 00010000:00010000:3.0:1788844671.866608:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844671.866612:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.866618:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844671.878309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844671.878561:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244824704 00000100:00100000:3.0:1788844671.878572:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244824704 00000100:00100000:3.0:1788844671.878612:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:3.0:1788844671.878628:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875739244824704:12345-192.168.204.43@tcp:8:bash.0 00010000:00080000:3.0:1788844671.878657:0:6688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:3.0:1788844671.878686:0:6688:0:(genops.c:1385:class_connect()) connect: client 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1, cookie 0x7f1093851e2d9c52 00002000:00100000:3.0:1788844671.878697:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1/ffff91eec2c3c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788844671.878720:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788844671.879086:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788844671.879123:0:6688:0:(import.c:65:import_set_state_nolock()) ffff91eec2c39000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788844671.879186:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2353:x1875739244824704:12345-192.168.204.43@tcp:8:bash.0 Request processed in 565us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844671.879194:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00000001:00100000:1.0:1788844671.880433:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:1.0:1788844671.880441:0:7640:0:(genops.c:885:class_export_put()) final put ffff91eed2c32800/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:2.0:1788844671.880532:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eed2c32800/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 for lustre-OST0001 00000020:00000080:2.0:1788844671.880601:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eed2c32000 for lustre-OST0001 00000100:00100000:2.0:1788844671.900052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844671.900210:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244824832 00000100:00100000:0.0:1788844671.900221:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244824832 00000100:00100000:0.0:1788844671.900344:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:0.0:1788844671.900355:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:0:x1875739244824832:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1788844671.900373:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844671.900392:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b3aa2d2/0x7f1093851e2d9c59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb2b expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788844671.900421:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788844671.900439:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1788844671.900444:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844671.900453:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b3aa2d2/0x7f1093851e2d9c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb2b expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.900488:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b3aa2d2/0x7f1093851e2d9c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb2b expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844671.900504:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030000, rc 0) 00000100:00100000:0.0:1788844671.900599:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:0:x1875739244824832:12345-192.168.204.43@tcp:101:bash.0 Request processed in 246us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844671.900607:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00080000:3.0:1788844671.900817:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788844671.915385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844671.915486:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244824960 00000100:00100000:2.0:1788844671.915498:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244824960 00000100:00100000:2.0:1788844671.915624:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:2.0:1788844671.915634:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:11355:x1875739244824960:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1788844671.915653:0:7066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844671.915670:0:7066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb32 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.915703:0:7066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b3aa2d2/0x7f1093851e2d9c59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb2b expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.915713:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844671.915717:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844671.915722:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.915758:0:7066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b3aa2d2/0x7f1093851e2d9c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb2b expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844671.915773:0:7066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b3aa2d2/0x7f1093851e2d9c59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb2b expref: 8 pid: 6687 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844671.915805:0:7066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7066:1875739267904768:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844671.915902:0:7066:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67600 going to sleep for 11 seconds 00000100:00100000:3.0:1788844671.927055:0:7066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7066:1875739267904768:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844671.927099:0:7066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844671.927119:0:7066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65200, rc 0) 00000100:00100000:0.0:1788844671.928948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844671.929294:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244825088 00000100:00100000:1.0:1788844671.929306:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244825088 00010000:00010000:1.0:1788844671.929347:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b3aa2d2/0x7f1093851e2d9c59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb2b expref: 9 pid: 6687 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844671.929401:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:1.0:1788844671.929412:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2355:x1875739244825088:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844671.929428:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844671.929452:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b3aa2d2/0x7f1093851e2d9c59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb2b expref: 9 pid: 6687 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844671.929466:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b3aa2d2/0x7f1093851e2d9c59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb2b expref: 9 pid: 6687 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844671.929493:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b3aa2d2/0x7f1093851e2d9c59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb2b expref: 9 pid: 6687 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844671.929510:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844671.929530:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844671.929590:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844671.929610:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844671.929910:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844671.929926:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5992680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1875739267904896:192.168.204.43@tcp:105: 00000100:00100000:1.0:1788844671.930025:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec7050240 going to sleep for 11 seconds 00000100:00100000:2.0:1788844671.930983:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:11355:x1875739244824960:12345-192.168.204.43@tcp:101:bash.0 Request processed in 15344us (15602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844671.930993:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:1.0:1788844671.932166:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5992680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1875739267904896:192.168.204.43@tcp:105: 00010000:00010000:1.0:1788844671.932188:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844671.932231:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244825088:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 2821us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844671.932250:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:0.0:1788844671.934874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844671.935151:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244825344 00000100:00100000:3.0:1788844671.935161:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244825344 00000100:00100000:3.0:1788844671.935274:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:3.0:1788844671.935284:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:11355:x1875739244825344:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:3.0:1788844671.935667:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:11355:x1875739244825344:12345-192.168.204.43@tcp:35:bash.0 Request processed in 383us (801us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788844671.935676:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:3.0:1788844672.104035:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844672.104274:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244825600 00000100:00100000:0.0:1788844672.104286:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244825600 00000100:00100000:0.0:1788844672.104353:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 144 00000100:00100000:0.0:1788844672.104363:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:11365:x1875739244825600:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1788844672.104399:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844672.104420:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb39 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844672.104520:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788844672.104676:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9c67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb39 expref: 20 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.104691:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:0.0:1788844672.104694:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788844672.104699:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb39 expref: 20 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.104727:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031600, rc 0) 00000100:00100000:0.0:1788844672.104808:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:11365:x1875739244825600:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 446us (787us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788844672.104816:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 144 00000100:00100000:0.0:1788844672.124057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844672.126967:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244825856 00000100:00100000:2.0:1788844672.126983:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244825856 00000100:00100000:2.0:1788844672.127068:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:2.0:1788844672.127080:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:11365:x1875739244825856:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:2.0:1788844672.127347:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11365:x1875739244825856:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 269us (3299us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788844672.127355:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 37 00010000:00010000:0.0:1788844672.186254:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844672.283448:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844672.283620:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244825984 00000100:00100000:3.0:1788844672.283630:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244825984 00000100:00100000:3.0:1788844672.283698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 145 00000100:00100000:3.0:1788844672.283708:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11371:x1875739244825984:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844672.283862:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844672.283885:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb40 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.283954:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9c7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.283982:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.283992:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844672.284027:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788844672.284031:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844672.284048:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.284075:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9c75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb40 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.284095:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9c7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb40 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.284104:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844672.284107:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788844672.284110:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025600, rc 0) 00000100:00100000:3.0:1788844672.284175:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11371:x1875739244825984:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 469us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844672.284182:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 145 00000100:00100000:3.0:1788844672.310246:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844672.312864:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244826240 00000100:00100000:0.0:1788844672.312880:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244826240 00000100:00100000:0.0:1788844672.312957:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 146 00000100:00100000:0.0:1788844672.312966:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11371:x1875739244826240:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1788844672.312985:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844672.313008:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9c83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb47 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.313103:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9c8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.313117:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.313129:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844672.313139:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788844672.313269:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9c83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb47 expref: 24 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.313439:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb47 expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.313450:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8400) 00010000:00010000:0.0:1788844672.313453:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788844672.313457:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030000, rc 0) 00000100:00100000:0.0:1788844672.313531:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:11371:x1875739244826240:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 565us (3308us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788844672.313595:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 146 00000100:00100000:0.0:1788844672.320223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844672.320280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844672.320385:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244826624 00000100:00100000:2.0:1788844672.320395:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244826624 00000100:00100000:2.0:1788844672.320457:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:2.0:1788844672.320466:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:2356:x1875739244826624:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844672.320482:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844672.320508:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9c8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb47 expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844672.320526:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8400) 00010000:00010000:2.0:1788844672.320531:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844672.320624:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:2356:x1875739244826624:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 158us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844672.320647:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:1.0:1788844672.320748:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244826496 00000100:00100000:1.0:1788844672.320754:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244826496 00000100:00100000:1.0:1788844672.320800:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 147 00000100:00100000:1.0:1788844672.320808:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:11371:x1875739244826496:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844672.320826:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844672.320843:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2d9c98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb4e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.320941:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9c9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.320955:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.320965:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844672.320977:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788844672.321109:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2d9c98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb4e expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.321124:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb4e expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.321131:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8400) 00010000:00010000:1.0:1788844672.321134:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788844672.321137:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60200, rc 0) 00000100:00100000:1.0:1788844672.321176:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:11371:x1875739244826496:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 369us (963us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788844672.321182:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 147 00000100:00100000:0.0:1788844672.330462:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.330574:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244826752 00000100:00100000:1.0:1788844672.330592:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244826752 00000100:00100000:1.0:1788844672.330638:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:1.0:1788844672.330646:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244826752:12345-192.168.204.43@tcp:1:lfs.0 00010000:00010000:1.0:1788844672.330688:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.330737:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.330746:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844672.330750:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788844672.330755:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.330789:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.330804:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 7 pid: 7066 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844672.330820:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5990a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1875739267905024:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844672.330910:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec7050240 going to sleep for 11 seconds 00000100:00100000:1.0:1788844672.334311:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5990a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1875739267905024:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844672.334341:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844672.336114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.336267:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244826880 00000100:00100000:1.0:1788844672.336276:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244826880 00002000:00100000:1.0:1788844672.336329:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91eed8285f80 x1875739244826880/t0(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:533/0 lens 504/0 e 0 to 0 dl 1788844683 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788844672.336359:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eed8285f80 with x1875739244826880 ext(0->12) 00010000:00010000:1.0:1788844672.336369:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 8 pid: 7066 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.336384:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 8 pid: 7066 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788844672.336392:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eed8285f80 00000100:00100000:1.0:1788844672.336424:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:1.0:1788844672.336434:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2355:x1875739244826880:12345-192.168.204.43@tcp:4:lfs.0 00000001:00100000:2.0:1788844672.414214:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000001:00080000:3.0:1788844672.466383:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1788844672.467327:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244826880:12345-192.168.204.43@tcp:4:lfs.0 Request processed in 130884us (131213us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788844672.467345:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00002000:00100000:0.0:1788844672.467358:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91eed8285f80 x1875739244826880/t4294967305(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:533/0 lens 504/448 e 0 to 0 dl 1788844683 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788844672.467369:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eed8285f80 with x1875739244826880 ext(0->12) 00010000:00010000:0.0:1788844672.467379:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 7 pid: 7066 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.467400:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 7 pid: 7066 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788844672.467435:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91eed8285f80 00000100:00100000:3.0:1788844672.470908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844672.471089:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244827008 00000100:00100000:0.0:1788844672.471100:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244827008 00010000:00010000:0.0:1788844672.471149:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 7 pid: 7066 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844672.471191:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:0.0:1788844672.471200:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2357:x1875739244827008:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844672.471217:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788844672.471248:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788844672.471251:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788844671 00002000:00010000:0.0:1788844672.471254:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788844671 00002000:00010000:0.0:1788844672.471256:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788844671 00002000:00010000:0.0:1788844672.471258:0:5826:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1788844672.471264:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 7 pid: 7066 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.471279:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 7 pid: 7066 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.471303:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec4d10cb/0x7f1093851e2d9c60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb32 expref: 7 pid: 7066 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.471322:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788844672.471327:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788844672.471350:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.471361:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.475819:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844672.475909:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2357:x1875739244827008:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 4703us (5192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844672.475921:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00010000:00010000:3.0:1788844672.478048:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.478089:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.478126:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.478134:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.478143:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.478150:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844672.478154:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.478163:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.478181:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.478188:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2d9cad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844672.478314:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244826752:12345-192.168.204.43@tcp:1:lfs.0 Request processed in 147663us (147857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844672.478324:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:3.0:1788844672.480784:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.480912:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244827264 00000100:00100000:1.0:1788844672.480922:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244827264 00000100:00100000:1.0:1788844672.480980:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:1.0:1788844672.480990:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:11371:x1875739244827264:12345-192.168.204.43@tcp:35:lfs.0 00000004:00010000:1.0:1788844672.481052:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb4e expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788844672.481335:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788844672.481378:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788844672.482205:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788844672.482277:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.482296:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb24 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.482315:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.482351:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb24 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.482366:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb24 expref: 28 pid: 5840 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844672.482381:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec5990a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1875739267905152:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844672.482474:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec7050240 going to sleep for 11 seconds 00000100:00100000:1.0:1788844672.485962:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec5990a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1875739267905152:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844672.485990:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844672.486243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844672.486425:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244827392 00000100:00100000:0.0:1788844672.486434:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244827392 00010000:00010000:0.0:1788844672.486470:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb24 expref: 29 pid: 5840 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844672.486509:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:0.0:1788844672.486519:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:2354:x1875739244827392:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844672.486570:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844672.486577:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb24 expref: 29 pid: 5840 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.486593:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb24 expref: 29 pid: 5840 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.486615:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb24 expref: 29 pid: 5840 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.486630:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8400) 00010000:00010000:0.0:1788844672.486647:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.486657:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.486666:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.486687:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844672.486742:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+28:2354:x1875739244827392:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 223us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844672.486749:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 63 00010000:00010000:3.0:1788844672.487109:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.487117:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788844672.487244:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788844672.487440:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788844672.487645:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01673800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875739267905280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788844672.487698:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844672.487879:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed2c6fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788844672.489358:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267905280 00000100:00100000:2.0:1788844672.489372:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267905280 00000100:00100000:3.0:1788844672.489611:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788844672.489622:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875739267905280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788844672.489959:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875739267905280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 339us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844672.489966:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788844672.490155:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01673800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875739267905280:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788844672.491129:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788844672.491209:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8286d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875739267905408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788844672.491272:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844672.491351:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbbd80 going to sleep for 11 seconds 00000100:00080000:1.0:1788844672.491511:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788844672.491951:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267905408 00000100:00100000:2.0:1788844672.491959:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267905408 00000100:00100000:2.0:1788844672.492004:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788844672.492012:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875739267905408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788844672.492269:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875739267905408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 257us (996us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788844672.492277:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788844672.492395:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8286d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875739267905408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788844672.492455:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788844672.492495:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.492505:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.492512:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.492563:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60400 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844672.492569:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.492578:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.492603:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8400) 00010000:00010000:1.0:1788844672.492606:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788844672.492612:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844672.492618:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9cb4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788844672.492998:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788844672.493143:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788844672.493156:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386771618293ns, next at 387771616008ns, rc = 0 00000001:00080000:1.0:1788844672.493162:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788844672.493196:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8400) 00010000:00010000:1.0:1788844672.493199:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788844672.493207:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9c9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb4e expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844672.493375:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:11371:x1875739244827264:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 12385us (12598us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788844672.493384:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00000020:00080000:1.0:1788844672.493388:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788844672.499704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844672.500083:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244827520 00000100:00100000:0.0:1788844672.500093:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244827520 00000100:00100000:0.0:1788844672.500161:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 148 00000100:00100000:0.0:1788844672.500171:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:11371:x1875739244827520:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1788844672.500196:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844672.500220:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9cbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb55 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.500297:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9cbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb55 expref: 32 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.500331:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9cbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb55 expref: 32 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.500354:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:0.0:1788844672.500357:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788844672.500361:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031e00, rc 0) 00000100:00100000:0.0:1788844672.500431:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:11371:x1875739244827520:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 260us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844672.500438:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 148 00000100:00100000:0.0:1788844672.507531:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.507706:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244827776 00000100:00100000:1.0:1788844672.507726:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244827776 00000100:00100000:1.0:1788844672.507788:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:1.0:1788844672.507801:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:11371:x1875739244827776:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844672.508030:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:11371:x1875739244827776:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 232us (507us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788844672.508038:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:1.0:1788844672.661484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844672.662727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244828032 00000100:00100000:3.0:1788844672.662740:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244828032 00000100:00100000:3.0:1788844672.662811:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 149 00000100:00100000:3.0:1788844672.662822:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+33:11382:x1875739244828032:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844672.662866:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844672.662888:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9cc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb5c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844672.662975:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788844672.663098:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9cc2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb5c expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.663113:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:3.0:1788844672.663117:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844672.663122:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9cc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb5c expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.663139:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025c00, rc 0) 00000100:00100000:3.0:1788844672.663228:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:11382:x1875739244828032:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 399us (1746us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788844672.663237:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 149 00000100:00100000:3.0:1788844672.669980:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844672.670118:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244828160 00000100:00100000:0.0:1788844672.670128:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244828160 00000100:00100000:0.0:1788844672.670191:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 150 00000100:00100000:0.0:1788844672.670201:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:11382:x1875739244828160:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:0.0:1788844672.670314:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9cd0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670331:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670342:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670355:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670362:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670387:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670475:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670482:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670488:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788844672.670530:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670583:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670591:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9cd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670598:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670604:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844672.670608:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670616:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9cd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670628:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:0.0:1788844672.670637:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844672.670642:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9cd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670648:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9cd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670661:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670667:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670673:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670677:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844672.670680:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670686:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670692:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eee1796d00) 00010000:00010000:0.0:1788844672.670695:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844672.670697:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9cd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670703:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670727:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670738:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670743:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670749:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844672.670752:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670758:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670766:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:0.0:1788844672.670768:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844672.670771:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844672.670776:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9cde lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844672.671003:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:11382:x1875739244828160:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 802us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844672.671011:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 150 00000100:00100000:0.0:1788844672.675216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.675389:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244828416 00000100:00100000:1.0:1788844672.675400:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244828416 00000100:00100000:1.0:1788844672.675457:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:1.0:1788844672.675467:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:11382:x1875739244828416:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844672.675750:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:11382:x1875739244828416:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 283us (543us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788844672.675758:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:1.0:1788844672.758895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844672.759023:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244828672 00000100:00100000:3.0:1788844672.759034:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244828672 00000100:00100000:3.0:1788844672.759096:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 151 00000100:00100000:3.0:1788844672.759105:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:11385:x1875739244828672:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844672.759127:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844672.759147:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9ce5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.759234:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9cec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.759261:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9cec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.759273:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9cec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.759289:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.759295:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.759300:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.759415:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.759423:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.759430:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844672.759439:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788844672.759528:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9cec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760398:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9cec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760410:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9cec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760428:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844672.760433:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9cec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760441:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9cec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760456:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844672.760459:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844672.760463:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9cec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760470:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9cec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760484:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760490:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9cf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760495:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760499:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844672.760501:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760507:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760523:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eed03a8800) 00010000:00010000:3.0:1788844672.760525:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844672.760528:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9cf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760631:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9cf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760689:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9ce5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb63 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760702:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb63 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844672.760719:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:3.0:1788844672.760722:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844672.760725:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025200, rc 0) 00000100:00100000:3.0:1788844672.760799:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:11385:x1875739244828672:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1693us (1915us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788844672.760807:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 151 00000100:00100000:3.0:1788844672.772890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844672.773006:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244828800 00000100:00100000:2.0:1788844672.773016:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244828800 00000100:00100000:2.0:1788844672.773095:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 152 00000100:00100000:2.0:1788844672.773106:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:11385:x1875739244828800:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:2.0:1788844672.773181:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844672.773199:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844672.773213:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844672.773259:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844672.773266:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844672.773289:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844672.773296:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844672.773301:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844672.773309:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844672.773323:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:2.0:1788844672.773327:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788844672.773332:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844672.773338:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844672.773420:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:11385:x1875739244828800:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 316us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844672.773429:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 152 00000100:00100000:2.0:1788844672.775724:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.776278:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244829056 00000100:00100000:1.0:1788844672.776289:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244829056 00000100:00100000:1.0:1788844672.776348:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:1.0:1788844672.776358:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:11385:x1875739244829056:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844672.776617:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+38:11385:x1875739244829056:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 260us (901us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788844672.776626:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:1.0:1788844672.965090:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.965136:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.965169:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.965355:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.965398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844672.965431:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244829312 00000100:00100000:1.0:1788844672.965440:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244829312 00000100:00100000:1.0:1788844672.965489:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244829696 00000100:00100000:1.0:1788844672.965493:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244829696 00000100:00100000:1.0:1788844672.965514:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 174 00000100:00100000:1.0:1788844672.965524:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+38:2355:x1875739244829312:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844672.965627:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+38:2355:x1875739244829312:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 103us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844672.965634:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 174 00000100:00100000:1.0:1788844672.965652:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 175 00000100:00100000:1.0:1788844672.965659:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244829696:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844672.965683:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:89582201-bdf6-4401-b202-b9313c368ae5+5:2355:x1875739244829696:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 25us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844672.965689:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 175 00000100:00100000:0.0:1788844672.965865:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244829184 00000100:00100000:0.0:1788844672.965870:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244829184 00000100:00100000:0.0:1788844672.965902:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 305 00000100:00100000:0.0:1788844672.965908:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2355:x1875739244829184:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844672.965968:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8438850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2355:x1875739244829184:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 59us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844672.965975:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 305 00000100:00100000:3.0:1788844672.967039:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244829568 00000100:00100000:3.0:1788844672.967050:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244829568 00000100:00100000:3.0:1788844672.967136:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244829440 00000100:00100000:3.0:1788844672.967140:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244829440 00000100:00100000:3.0:1788844672.967184:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:3.0:1788844672.967191:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2355:x1875739244829568:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844672.967260:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2355:x1875739244829568:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 69us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844672.967267:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:3.0:1788844672.967287:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:3.0:1788844672.967294:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244829440:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844672.967317:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244829440:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 24us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844672.967324:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00080000:1.0:1788844672.968324:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788844673.210119:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844673.273893:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267905920:0@lo:400:kworker.0 00000100:00100000:2.0:1788844673.273969:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844673.274032:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788844673.274039:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267905792:0@lo:400:kworker.0 00000100:00100000:2.0:1788844673.274066:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844673.274246:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267905664:0@lo:400:kworker.0 00000100:00100000:3.0:1788844673.274277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844673.274304:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267906176:0@lo:400:kworker.0 00000100:00100000:3.0:1788844673.274324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844673.274342:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788844673.274346:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed84d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267905536:0@lo:400:kworker.0 00000100:00100000:3.0:1788844673.274370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844673.274389:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267906048:0@lo:400:kworker.0 00000100:00100000:3.0:1788844673.274407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844673.274431:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267905920 00000100:00100000:3.0:1788844673.274438:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267905920 00000100:00100000:3.0:1788844673.274480:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267906176 00000100:00100000:3.0:1788844673.274483:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267906176 00000100:00100000:3.0:1788844673.274507:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788844673.274515:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267905920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844673.274589:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267905920:12345-0@lo:400:kworker.0 Request processed in 74us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844673.274607:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788844673.274630:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788844673.274636:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267906176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844673.274669:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267906176:12345-0@lo:400:kworker.0 Request processed in 33us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844673.274675:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788844673.274726:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267906176:0@lo:400:kworker.0 00000100:00100000:3.0:1788844673.274764:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267905920:0@lo:400:kworker.0 00000100:00100000:1.0:1788844673.274984:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267905536 00000100:00100000:1.0:1788844673.274989:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267905536 00000100:00100000:1.0:1788844673.275021:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788844673.275027:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed843b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267905536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844673.275069:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed843b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267905536:12345-0@lo:400:kworker.0 Request processed in 42us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844673.275075:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:1.0:1788844673.275102:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788844673.275122:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed84d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267905536:0@lo:400:kworker.0 00000100:00100000:1.0:1788844673.275152:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267905792 00000100:00100000:1.0:1788844673.275155:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267905792 00000100:00100000:1.0:1788844673.275183:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267905664 00000100:00100000:1.0:1788844673.275185:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267905664 00000100:00100000:1.0:1788844673.275194:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267906048 00000100:00100000:1.0:1788844673.275197:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267906048 00000100:00100000:1.0:1788844673.275221:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788844673.275228:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267905792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844673.275267:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267905792:12345-0@lo:400:kworker.0 Request processed in 40us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844673.275273:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788844673.275284:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788844673.275289:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267905664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844673.275320:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267905664:12345-0@lo:400:kworker.0 Request processed in 30us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844673.275325:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788844673.275336:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788844673.275341:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267906048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844673.275369:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267906048:12345-0@lo:400:kworker.0 Request processed in 28us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844673.275374:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1788844673.275390:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844673.275408:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267905792:0@lo:400:kworker.0 00000100:00100000:1.0:1788844673.275430:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267906048:0@lo:400:kworker.0 00000100:00100000:1.0:1788844673.275438:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267905664:0@lo:400:kworker.0 00000100:00100000:1.0:1788844673.467332:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844673.468005:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244829952 00000100:00100000:2.0:1788844673.468018:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244829952 00000100:00100000:2.0:1788844673.468106:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 153 00000100:00100000:2.0:1788844673.468116:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+38:11416:x1875739244829952:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:2.0:1788844673.468136:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844673.468157:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb6a expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.468272:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.468287:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.468298:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844673.468308:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788844673.468435:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb6a expref: 41 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.468455:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb6a expref: 40 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.468462:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:2.0:1788844673.468465:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788844673.468469:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65a00, rc 0) 00000100:00080000:1.0:1788844673.468876:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844673.469564:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+40:11416:x1875739244829952:12345-192.168.204.43@tcp:101:cat.0 Request processed in 1416us (2209us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788844673.469584:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 153 00000100:00100000:1.0:1788844673.486191:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844673.486315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844673.486979:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244830208 00000100:00100000:2.0:1788844673.486990:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244830208 00000100:00100000:2.0:1788844673.487054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:2.0:1788844673.487065:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+40:11416:x1875739244830208:12345-192.168.204.43@tcp:35:cat.0 00000100:00100000:2.0:1788844673.487333:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+41:11416:x1875739244830208:12345-192.168.204.43@tcp:35:cat.0 Request processed in 267us (1153us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788844673.487340:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:3.0:1788844673.488162:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244830336 00000100:00100000:3.0:1788844673.488169:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244830336 00000100:00100000:3.0:1788844673.488227:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:3.0:1788844673.488235:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+41:2355:x1875739244830336:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844673.488250:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844673.488275:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb6a expref: 41 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844673.488293:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:3.0:1788844673.488298:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844673.488327:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+40:2355:x1875739244830336:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 93us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844673.488333:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:0.0:1788844673.645142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844673.645251:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244830592 00000100:00100000:1.0:1788844673.645261:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244830592 00000100:00100000:1.0:1788844673.645327:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 154 00000100:00100000:1.0:1788844673.645337:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+40:11422:x1875739244830592:12345-192.168.204.43@tcp:101:dd.0 00010000:00010000:1.0:1788844673.645361:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844673.645364:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788844673.645392:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9c7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb40 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.645410:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:1.0:1788844673.645416:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788844673.645430:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.645529:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.645597:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb63 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.645606:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.645641:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb63 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.645673:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb63 expref: 40 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844673.645688:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267906304:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844673.645801:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed9bb5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788844673.662766:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267906304:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844673.662800:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844673.674863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844673.675343:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244830720 00000100:00100000:1.0:1788844673.675352:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244830720 00010000:00010000:1.0:1788844673.675394:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb63 expref: 41 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844673.675434:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:1.0:1788844673.675444:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+41:2354:x1875739244830720:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844673.675457:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844673.675464:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb63 expref: 41 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.675487:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb63 expref: 41 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.675509:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9cfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb63 expref: 41 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.675526:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:1.0:1788844673.675531:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.675623:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.675631:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844673.675662:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844673.675727:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+40:2354:x1875739244830720:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 283us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844673.675735:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 64 00010000:00010000:2.0:1788844673.676074:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.676083:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844673.676101:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788844673.676260:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb71 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.676277:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb71 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.676285:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:2.0:1788844673.676287:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788844673.676290:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61400, rc 0) 00000100:00100000:2.0:1788844673.676316:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+40:11422:x1875739244830592:12345-192.168.204.43@tcp:101:dd.0 Request processed in 30981us (31185us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788844673.676332:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 154 00000100:00100000:1.0:1788844673.681298:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844673.681367:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244830976 00000100:00100000:2.0:1788844673.681377:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244830976 00000100:00100000:2.0:1788844673.681435:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 155 00000100:00100000:2.0:1788844673.681445:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+40:11422:x1875739244830976:12345-192.168.204.43@tcp:36:dd.0 00010000:00010000:2.0:1788844673.681756:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.681773:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.681784:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788844673.681836:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788844673.681861:0:8217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ae3812a reply state 00000000382e260f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844673.681869:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844673.681958:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+43:11422:x1875739244830976:12345-192.168.204.43@tcp:36:dd.0 Request processed in 513us (670us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788844673.681965:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 155 00000020:00080000:2.0:1788844673.681970:0:8217:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788844673.688605:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.688624:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.688632:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.688652:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844673.688658:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.688667:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.688685:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:2.0:1788844673.688688:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844673.688693:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844673.688700:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788844673.785786:0:8088:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388064246324ns, next at 389064243712ns, rc = 0 00000100:00100000:1.0:1788844673.785935:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267906432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844673.786023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844673.786237:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267906432 00000100:00100000:0.0:1788844673.786246:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267906432 00000100:00100000:0.0:1788844673.786301:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788844673.786311:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267906432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788844673.786347:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844673.786401:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875739267906432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844673.786409:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788844673.786611:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267906432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844674.033843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844674.034027:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244831104 00000100:00100000:2.0:1788844674.034039:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244831104 00000100:00100000:2.0:1788844674.034111:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 156 00000100:00100000:2.0:1788844674.034122:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+42:11436:x1875739244831104:12345-192.168.204.43@tcp:101:stat.0 00010000:00010000:2.0:1788844674.034149:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844674.034174:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb78 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.034271:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.034308:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.034323:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.034340:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9d4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.034348:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.034355:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.035132:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.035148:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb71 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.035156:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.035205:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb71 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.035222:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb71 expref: 43 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844674.035253:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267906560:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844674.035508:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec33c8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788844674.048128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844674.048305:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244831360 00000100:00100000:1.0:1788844674.048316:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244831360 00000100:00100000:1.0:1788844674.048383:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:1.0:1788844674.048395:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+44:5597:x1875739244831360:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788844674.048909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+45:5597:x1875739244831360:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 514us (788us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788844674.048917:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:2.0:1788844674.051048:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267906560:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844674.051082:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844674.056349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844674.056848:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244831488 00000100:00100000:2.0:1788844674.056858:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244831488 00010000:00010000:2.0:1788844674.056898:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb71 expref: 45 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844674.056941:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 65 00000100:00100000:2.0:1788844674.056951:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+45:2355:x1875739244831488:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844674.056969:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844674.056976:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb71 expref: 45 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.056989:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb71 expref: 45 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.057021:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb71 expref: 45 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.057039:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:2.0:1788844674.057045:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.057067:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.057074:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.057109:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844674.057170:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+44:2355:x1875739244831488:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 219us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844674.057177:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 65 00010000:00010000:3.0:1788844674.057257:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057276:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844674.057320:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788844674.057324:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844674.057345:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057358:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057379:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057386:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057392:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057398:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844674.057401:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057408:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057418:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844674.057421:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844674.057425:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057441:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057454:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057460:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9d4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057466:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057471:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844674.057473:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057480:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9d4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057488:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eec2f43500) 00010000:00010000:3.0:1788844674.057491:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844674.057493:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9d4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057499:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2d9d4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057532:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65e00/0x7f1093851e2d9d40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb78 expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057616:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb78 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.057629:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:3.0:1788844674.057632:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844674.057635:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64600, rc 0) 00000100:00100000:3.0:1788844674.057664:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+43:11436:x1875739244831104:12345-192.168.204.43@tcp:101:stat.0 Request processed in 23544us (23833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844674.057670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 156 00000100:00100000:3.0:1788844674.134662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844674.136471:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244831744 00000100:00100000:2.0:1788844674.136484:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244831744 00000100:00100000:2.0:1788844674.136586:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 157 00000100:00100000:2.0:1788844674.136596:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+43:11442:x1875739244831744:12345-192.168.204.43@tcp:36:truncate.0 00010000:00010000:2.0:1788844674.136653:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844674.136680:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb78 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.136709:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:2.0:1788844674.136724:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788844674.136916:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.136929:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.136938:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788844674.138430:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788844674.138478:0:8217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b9c724f reply state 000000005f2e2e30 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844674.138488:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844674.138627:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+45:11442:x1875739244831744:12345-192.168.204.43@tcp:36:truncate.0 Request processed in 2028us (3971us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788844674.138635:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 157 00000020:00080000:2.0:1788844674.138640:0:8217:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788844674.146703:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.146723:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.146731:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.146737:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65400 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844674.146741:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.146749:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.146766:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:2.0:1788844674.146769:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844674.146774:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.146781:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2d9d5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844674.235613:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844674.299933:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267906688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844674.300007:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844674.300659:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267906688 00000100:00100000:0.0:1788844674.300669:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267906688 00000100:00100000:0.0:1788844674.300961:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788844674.300972:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267906688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788844674.301017:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844674.301095:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267906688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844674.301103:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788844674.301185:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267906688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844674.346156:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844674.348718:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244831872 00000100:00100000:1.0:1788844674.348736:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244831872 00000100:00100000:1.0:1788844674.348814:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 158 00000100:00100000:1.0:1788844674.348825:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+44:11456:x1875739244831872:12345-192.168.204.43@tcp:101:stat.0 00010000:00010000:1.0:1788844674.348849:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844674.348886:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb7f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.348956:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.348970:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.348982:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.348996:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349002:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349007:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349095:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349105:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349111:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844674.349148:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788844674.349153:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844674.349174:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349204:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349214:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349221:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349227:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349233:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844674.349237:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349244:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349256:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:1.0:1788844674.349259:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844674.349263:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349269:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9d6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349283:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349290:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349302:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349308:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844674.349311:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349317:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349325:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eec7351000) 00010000:00010000:1.0:1788844674.349327:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844674.349329:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349334:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349371:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb7f expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349385:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb7f expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.349392:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:1.0:1788844674.349395:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844674.349397:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61a00, rc 0) 00000100:00100000:1.0:1788844674.349479:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+45:11456:x1875739244831872:12345-192.168.204.43@tcp:101:stat.0 Request processed in 655us (3334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844674.349499:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 158 00000100:00100000:3.0:1788844674.475127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844674.475462:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244832128 00000100:00100000:1.0:1788844674.475477:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244832128 00000100:00100000:1.0:1788844674.475604:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 159 00000100:00100000:1.0:1788844674.475618:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+45:11466:x1875739244832128:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844674.475651:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844674.475864:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb86 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844674.476004:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788844674.476178:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb86 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.476207:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:1.0:1788844674.476210:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788844674.476225:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb86 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.476247:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61400, rc 0) 00000100:00100000:1.0:1788844674.476384:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+46:11466:x1875739244832128:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 769us (1274us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788844674.476392:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 159 00000100:00100000:3.0:1788844674.480946:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844674.481107:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244832384 00000100:00100000:1.0:1788844674.481122:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244832384 00000100:00100000:1.0:1788844674.481223:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:1.0:1788844674.481235:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+46:11466:x1875739244832384:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844674.482038:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+47:11466:x1875739244832384:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 801us (1107us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788844674.482049:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:3.0:1788844674.578812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844674.578943:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244832640 00000100:00100000:1.0:1788844674.578959:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244832640 00000100:00100000:1.0:1788844674.579040:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 160 00000100:00100000:1.0:1788844674.579052:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+47:11472:x1875739244832640:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1788844674.579086:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844674.579114:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb8d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.579304:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.579323:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb7f expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.579333:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.579378:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb7f expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.579394:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb7f expref: 48 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844674.579410:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267906816:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844674.579597:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed9bb5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788844674.582500:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267906816:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844674.582584:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844674.585177:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844674.585451:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244832768 00000100:00100000:2.0:1788844674.585465:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244832768 00010000:00010000:2.0:1788844674.585519:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb7f expref: 49 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844674.585625:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:2.0:1788844674.585637:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+49:2357:x1875739244832768:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844674.585657:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844674.585665:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb7f expref: 49 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.585691:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb7f expref: 49 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.585720:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9d78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb7f expref: 49 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.585742:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:2.0:1788844674.585748:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.585759:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.585767:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.585806:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844674.585897:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+48:2357:x1875739244832768:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 261us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844674.585906:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 66 00010000:00010000:1.0:1788844674.586243:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.586253:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844674.586279:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788844674.586491:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9d8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb8d expref: 49 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.586510:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb8d expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.586518:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:1.0:1788844674.586520:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788844674.586523:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60a00, rc 0) 00000100:00100000:1.0:1788844674.586619:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+48:11472:x1875739244832640:12345-192.168.204.43@tcp:101:bash.0 Request processed in 7568us (7824us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788844674.586627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 160 00000100:00100000:0.0:1788844674.597041:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844674.597224:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244833024 00000100:00100000:2.0:1788844674.597246:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244833024 00000100:00100000:2.0:1788844674.597323:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 161 00000100:00100000:2.0:1788844674.597335:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+48:11472:x1875739244833024:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:2.0:1788844674.597744:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.597764:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.597777:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788844674.597838:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788844674.597864:0:8217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afb4e12f reply state 0000000052aaea24 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844674.597874:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844674.597992:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+51:11472:x1875739244833024:12345-192.168.204.43@tcp:36:bash.0 Request processed in 658us (976us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788844674.598000:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 161 00000020:00080000:2.0:1788844674.598006:0:8217:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788844674.601219:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.601255:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.601288:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.601296:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844674.601302:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.601310:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.601332:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:2.0:1788844674.601336:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844674.601341:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.601347:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9da2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844674.606892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844674.607660:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244833152 00000100:00100000:3.0:1788844674.607779:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244833152 00000100:00100000:3.0:1788844674.607911:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 162 00000100:00100000:3.0:1788844674.607924:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+50:11472:x1875739244833152:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844674.607955:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844674.607983:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9da9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb94 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.608095:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.608131:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb8d expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.608141:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.608196:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb8d expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.608219:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb8d expref: 51 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844674.608236:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267906944:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844674.608360:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed0389240 going to sleep for 11 seconds 00000100:00100000:2.0:1788844674.614204:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267906944:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844674.614257:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844674.615165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844674.615790:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244833280 00000100:00100000:2.0:1788844674.615803:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244833280 00010000:00010000:2.0:1788844674.615855:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb8d expref: 52 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844674.615908:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 67 00000100:00100000:2.0:1788844674.615920:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:2355:x1875739244833280:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844674.615951:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844674.615960:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb8d expref: 52 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.615975:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb8d expref: 52 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.616005:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9d94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb8d expref: 52 pid: 5838 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.616027:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:2.0:1788844674.616032:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.616043:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.616052:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.616090:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844674.616160:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+51:2355:x1875739244833280:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 242us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844674.616168:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 67 00010000:00010000:0.0:1788844674.616530:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844674.616617:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844674.616693:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788844674.616699:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788844674.616732:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844674.616774:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9da9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb94 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844674.616793:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb94 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844674.616801:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:0.0:1788844674.616804:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788844674.616807:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025c00, rc 0) 00000100:00100000:0.0:1788844674.616846:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+50:11472:x1875739244833152:12345-192.168.204.43@tcp:101:bash.0 Request processed in 8926us (9970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844674.616854:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 162 00000100:00100000:3.0:1788844674.620028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844674.620119:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244833536 00000100:00100000:2.0:1788844674.620131:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244833536 00000100:00100000:2.0:1788844674.620196:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:2.0:1788844674.620214:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+50:11472:x1875739244833536:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:2.0:1788844674.620524:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+51:11472:x1875739244833536:12345-192.168.204.43@tcp:35:bash.0 Request processed in 318us (509us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788844674.620533:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:2.0:1788844674.752750:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844674.758935:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244833792 00000100:00100000:1.0:1788844674.758951:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244833792 00000100:00100000:1.0:1788844674.759036:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 163 00000100:00100000:1.0:1788844674.759046:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+51:11482:x1875739244833792:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844674.759083:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844674.759104:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9db7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fb9b expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844674.759209:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788844674.759333:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9db7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb9b expref: 53 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.759349:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:1.0:1788844674.759352:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788844674.759357:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9db7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb9b expref: 53 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.759387:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61400, rc 0) 00000100:00100000:1.0:1788844674.759458:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:11482:x1875739244833792:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 414us (6720us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788844674.759466:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 163 00000100:00100000:3.0:1788844674.763313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844674.763408:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244833920 00000100:00100000:1.0:1788844674.763420:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244833920 00000100:00100000:1.0:1788844674.763486:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 164 00000100:00100000:1.0:1788844674.763498:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:11482:x1875739244833920:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:1.0:1788844674.763605:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9dc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763624:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763639:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763669:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9dcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763686:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763693:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763790:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763800:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763807:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788844674.763848:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763862:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763868:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9dc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763875:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763881:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844674.763885:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763900:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763913:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:1.0:1788844674.763916:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844674.763921:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9dc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763927:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9dc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763943:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763949:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9dcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763955:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9dcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.763960:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844674.763963:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9dcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.764212:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9dcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.764221:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eec7351000) 00010000:00010000:1.0:1788844674.764224:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844674.764227:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9dcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.764243:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9dcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.764259:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.764265:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.764273:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.764278:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60400 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844674.764281:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.764287:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.764295:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:1.0:1788844674.764298:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844674.764301:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.764306:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9dd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844674.764472:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:11482:x1875739244833920:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 973us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844674.764481:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 164 00000100:00100000:2.0:1788844674.766838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844674.767098:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244834176 00000100:00100000:3.0:1788844674.767108:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244834176 00000100:00100000:3.0:1788844674.767159:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:3.0:1788844674.767168:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:11482:x1875739244834176:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1788844674.767446:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+53:11482:x1875739244834176:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 278us (616us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788844674.767454:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:3.0:1788844674.857434:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844674.857484:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244834432 00000100:00100000:3.0:1788844674.857497:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244834432 00000100:00100000:3.0:1788844674.857616:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 165 00000100:00100000:3.0:1788844674.857628:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+53:11485:x1875739244834432:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844674.857672:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844674.857699:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9dda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fba2 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.857803:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9de1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.857821:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9de1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.857837:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9de1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.857854:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9de8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.857861:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.857867:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858405:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9def lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858416:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858423:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844674.858447:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788844674.858650:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9de1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858673:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9de1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858681:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9de1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858689:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844674.858694:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9de1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858704:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9de1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858720:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844674.858724:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844674.858729:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9de1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858736:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9de1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858750:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858758:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9de8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858774:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858780:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844674.858783:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858791:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9de8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858799:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eed03a8800) 00010000:00010000:3.0:1788844674.858801:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844674.858804:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9de8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858810:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9de8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858861:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9dda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fba2 expref: 56 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858877:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9def lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fba2 expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.858885:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:3.0:1788844674.858887:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844674.858890:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024200, rc 0) 00000100:00100000:3.0:1788844674.858970:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:11485:x1875739244834432:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1344us (1550us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788844674.859856:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 165 00000100:00100000:2.0:1788844674.864478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844674.865172:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244834560 00000100:00100000:3.0:1788844674.865196:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244834560 00000100:00100000:3.0:1788844674.865427:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 166 00000100:00100000:3.0:1788844674.865439:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:11485:x1875739244834560:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:3.0:1788844674.865561:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.865583:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.865597:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.865631:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.865638:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9dfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.865645:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.865652:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844674.865656:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.865905:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9dfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.865924:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:3.0:1788844674.866374:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844674.866381:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9dfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.866389:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844674.866569:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:11485:x1875739244834560:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 1129us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844674.866578:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 166 00000100:00100000:0.0:1788844674.867846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844674.868349:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244834688 00000100:00100000:1.0:1788844674.868362:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244834688 00000100:00100000:1.0:1788844674.873867:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1788844674.873904:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:2356:x1875739244834688:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844674.873933:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844674.873973:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2d9def lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fba2 expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.874011:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:1.0:1788844674.874016:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844674.874118:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:2356:x1875739244834688:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 233us (6280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844674.874127:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:0.0:1788844674.881073:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844674.883645:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244834944 00000100:00100000:3.0:1788844674.883678:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244834944 00000100:00100000:3.0:1788844674.883777:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:3.0:1788844674.883789:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:11485:x1875739244834944:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:3.0:1788844674.884337:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:11485:x1875739244834944:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 549us (3278us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788844674.884346:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00000001:00080000:1.0:1788844674.936835:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967429 is committed 00000020:00080000:1.0:1788844674.936856:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eed1dbb0c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788844674.936862:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eec6b09a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eed1dbbb40 00000020:00080000:1.0:1788844674.936866:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eec6b09300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eed05c2c00 00000001:00080000:1.0:1788844674.936898:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967451 is committed 00000004:00080000:1.0:1788844674.936920:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788844674.936986:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:1.0:1788844674.937011:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000020:00080000:3.0:1788844674.937123:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788844674.937392:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788844674.938302:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788844674.938329:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267907072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788844674.938427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844674.941134:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267907072 00000100:00100000:1.0:1788844674.941154:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267907072 00000100:00100000:1.0:1788844674.941980:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788844674.942010:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267907072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788844674.942324:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1788844674.942370:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f9a7f, atime: 0x6a9f9a7f, ctime: 0x6a9f9a7f, blocks: 0xb 00010000:00010000:1.0:1788844674.942379:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2d9e04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.942401:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:1.0:1788844674.942406:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844674.942414:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2d9e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.942434:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2d9e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.942444:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2d9e04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.942453:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2d9e04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844674.942518:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1788844674.944625:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788844674.947881:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eeff8b2680/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788844674.947903:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267907072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788844674.949446:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875739267907072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7428us (11005us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788844674.949464:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1788844674.954292:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844674.954314:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2d9e04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.954331:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60400 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844674.954337:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2d9e04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.954350:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2d9e04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.954406:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2d9e04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844674.954414:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2d9e04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844674.958654:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844674.965564:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844674.965569:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844675.234796:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844675.235079:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244835200 00000100:00100000:3.0:1788844675.235093:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244835200 00000100:00080000:2.0:1788844675.235375:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844675.235680:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 167 00000100:00100000:3.0:1788844675.235695:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:11503:x1875739244835200:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:3.0:1788844675.235730:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844675.235759:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fba9 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844675.235900:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844675.235919:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844675.235945:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844675.235966:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788844675.236153:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fba9 expref: 21 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844675.236218:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fba9 expref: 20 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844675.236228:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:3.0:1788844675.236231:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788844675.236235:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844675.236329:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11503:x1875739244835200:12345-192.168.204.43@tcp:101:cat.0 Request processed in 639us (1549us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788844675.236338:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 167 00010000:00010000:0.0:1788844675.257871:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788844675.258252:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788844675.258261:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788844675.259052:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788844675.259087:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788844675.293803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844675.293944:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244835328 00000100:00100000:2.0:1788844675.293961:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244835328 00000100:00100000:2.0:1788844675.294053:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 168 00000100:00100000:2.0:1788844675.294067:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11504:x1875739244835328:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844675.294098:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844675.294125:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d9e20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbb0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.294229:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9e27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.294257:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.294271:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844675.294339:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788844675.294343:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844675.294368:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.294408:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d9e20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb0 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.294430:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb0 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.294439:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:2.0:1788844675.294442:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844675.294447:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65800, rc 0) 00000100:00100000:2.0:1788844675.294529:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11504:x1875739244835328:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 466us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844675.294598:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 168 00000100:00100000:1.0:1788844675.310792:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844675.310943:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244835712 00000100:00100000:3.0:1788844675.310958:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244835712 00000100:00100000:3.0:1788844675.311038:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:3.0:1788844675.311051:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11504:x1875739244835712:12345-192.168.204.43@tcp:35:lfs.0 00000001:00080000:3.0:1788844675.311472:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967456 00000100:00100000:3.0:1788844675.311665:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:11504:x1875739244835712:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 616us (891us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788844675.311676:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00000020:00080000:3.0:1788844675.311683:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788844675.316428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844675.316573:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244835840 00000100:00100000:3.0:1788844675.316587:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244835840 00000100:00100000:3.0:1788844675.316673:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:3.0:1788844675.316697:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:11504:x1875739244835840:12345-192.168.204.43@tcp:103:lfs.0 00010000:00010000:3.0:1788844675.316721:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788844675.316756:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9db0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb94 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844675.316810:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fba9 expref: 22 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844675.316826:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9cbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb55 expref: 21 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844675.316838:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796e00) 00010000:00010000:3.0:1788844675.316850:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844675.316926:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11504:x1875739244835840:12345-192.168.204.43@tcp:103:lfs.0 Request processed in 242us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844675.316935:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:0.0:1788844675.328055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844675.328244:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244835968 00000100:00100000:3.0:1788844675.328258:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244835968 00000100:00100000:3.0:1788844675.328346:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 169 00000100:00100000:3.0:1788844675.328360:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11504:x1875739244835968:12345-192.168.204.43@tcp:58:lfs.0 00010000:00010000:3.0:1788844675.328517:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844675.328586:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844675.328602:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788844675.329298:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788844675.329421:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11504:x1875739244835968:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 1060us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844675.329443:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 169 00000100:00100000:1.0:1788844675.406278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844675.406356:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244836096 00000100:00100000:2.0:1788844675.406370:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244836096 00000100:00100000:2.0:1788844675.406486:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 170 00000100:00100000:2.0:1788844675.406499:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11506:x1875739244836096:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844675.406525:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844675.406605:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d9e35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbb7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.406689:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9e3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.406728:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9e3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.406743:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9e3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.406761:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d9e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.406770:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d9e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.406777:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d9e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407111:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407121:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407129:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844675.407188:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788844675.407194:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844675.407215:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407229:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407250:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9e3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407257:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9e3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407264:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9e3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407271:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844675.407276:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9e3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407285:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9e3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407300:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:2.0:1788844675.407303:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844675.407308:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9e3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407315:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9e3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407328:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d9e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407334:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d9e43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407340:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d9e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407352:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64400 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844675.407355:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d9e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407362:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d9e43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407371:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eec2f43300) 00010000:00010000:2.0:1788844675.407374:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844675.407377:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d9e43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407383:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64400/0x7f1093851e2d9e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407419:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2d9e35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb7 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407433:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb7 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844675.407441:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8f00) 00010000:00010000:2.0:1788844675.407444:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844675.407446:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64a00, rc 0) 00000100:00100000:2.0:1788844675.407528:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11506:x1875739244836096:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1031us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844675.407585:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 170 00000040:00080000:1.0:1788844676.281828:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788844676.281843:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788844676.281920:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788844676.281930:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788844676.282124:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc1909880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267907200:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788844676.282259:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec710db40 going to sleep for 11 seconds 00010000:00010000:2.0:1788844676.283396:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844676.288509:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc1909880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267907200:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788844676.290315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.290701:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244836224 00000100:00100000:3.0:1788844676.290715:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244836224 00000100:00100000:3.0:1788844676.290794:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 171 00000100:00100000:3.0:1788844676.290806:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11517:x1875739244836224:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788844676.290859:0:5840:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788844676.290999:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11517:x1875739244836224:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 193us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.291008:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 171 00000100:00100000:1.0:1788844676.300986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.301593:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244836352 00000100:00100000:3.0:1788844676.301607:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244836352 00000100:00100000:3.0:1788844676.301696:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 172 00000100:00100000:3.0:1788844676.301709:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc190a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11517:x1875739244836352:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788844676.301807:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9e51 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.301841:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9e51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.301857:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9e51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.301875:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e58 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.301882:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.301908:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.301940:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.301948:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.301954:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844676.301999:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788844676.302003:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844676.302018:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302031:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9e51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302038:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9e51 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302045:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9e51 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302051:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844676.302056:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9e51 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302064:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9e51 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302084:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:3.0:1788844676.302088:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844676.302093:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9e51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302099:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9e51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302115:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302122:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e58 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302128:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302133:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844676.302136:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302141:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e58 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302148:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff91eed03a8800) 00010000:00010000:3.0:1788844676.302161:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844676.302164:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e58 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302171:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e58 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302202:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302207:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302213:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302219:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844676.302222:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302227:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302234:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8f00) 00010000:00010000:3.0:1788844676.302237:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844676.302240:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.302246:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844676.302341:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc190a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11517:x1875739244836352:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 Request processed in 633us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.302350:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 172 00000100:00100000:0.0:1788844676.305185:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.305488:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244836608 00000100:00100000:3.0:1788844676.305503:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244836608 00000100:00100000:3.0:1788844676.305614:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 173 00000100:00100000:3.0:1788844676.305646:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11517:x1875739244836608:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844676.305674:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844676.305701:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9e66 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306053:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9e6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306072:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306086:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844676.306100:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788844676.306240:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306248:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9e6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306256:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306262:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844676.306267:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306276:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9e6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306291:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8f00) 00010000:00010000:3.0:1788844676.306302:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788844676.306308:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9e6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306315:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306369:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9e66 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbbe expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306381:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:3.0:1788844676.306383:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844676.306387:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9e66 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbbe expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.306398:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024e00, rc 0) 00000100:00100000:3.0:1788844676.307053:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:11517:x1875739244836608:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1408us (1878us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1788844676.307063:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 173 00000100:00100000:2.0:1788844676.312240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.312702:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244836736 00000100:00100000:3.0:1788844676.312717:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244836736 00000100:00100000:3.0:1788844676.312784:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 174 00000100:00100000:3.0:1788844676.312796:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:11517:x1875739244836736:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788844676.312844:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788844676.312986:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:11517:x1875739244836736:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 191us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.312994:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 174 00000100:00100000:1.0:1788844676.319928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.320910:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244836992 00000100:00100000:3.0:1788844676.320947:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244836992 00000100:00100000:3.0:1788844676.321032:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 175 00000100:00100000:3.0:1788844676.321043:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc190b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:11517:x1875739244836992:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844676.321073:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844676.321077:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788844676.321124:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2d9e27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb0 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.321161:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844676.321168:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844676.321188:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbc5 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788844676.322176:0:8217:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788844676.322518:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.322563:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.322577:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.322657:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9e7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbc5 expref: 24 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.322675:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbc5 expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.322697:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eed03a8800) 00010000:00010000:3.0:1788844676.322701:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844676.322704:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025200, rc 0) 00000100:00100000:3.0:1788844676.322800:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc190b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:11517:x1875739244836992:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1758us (2884us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788844676.322809:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 175 00000100:00100000:3.0:1788844676.331241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844676.331338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244837248 00000100:00100000:2.0:1788844676.331353:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244837248 00000100:00100000:2.0:1788844676.331434:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 176 00000100:00100000:2.0:1788844676.331447:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:11517:x1875739244837248:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788844676.331529:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844676.331591:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2d9e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbc5 expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.331614:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eed03a8800) 00010000:00010000:2.0:1788844676.331630:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788844676.331662:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9e90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.331679:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9e90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.331691:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9e90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.331708:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9e97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5fffb37f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.331721:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9e97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5fffb37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.331728:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9e97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5fffb37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332009:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9e90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332030:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9e90 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332036:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9e90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332043:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844676.332048:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9e90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332056:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9e90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332066:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:2.0:1788844676.332069:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844676.332074:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9e90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332080:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9e90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332093:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9e97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5fffb37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332099:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9e97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5fffb37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332105:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9e97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5fffb37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332110:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844676.332119:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9e97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5fffb37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332126:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9e97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5fffb37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332135:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5fffb37f (ffff91eec2f43e00) 00010000:00010000:2.0:1788844676.332137:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844676.332141:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9e97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5fffb37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.332147:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9e97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5fffb37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844676.332275:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:11517:x1875739244837248:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 829us (1047us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788844676.332285:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 176 00000100:00100000:2.0:1788844676.337374:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844676.340310:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244837376 00000100:00100000:0.0:1788844676.340335:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244837376 00000100:00100000:0.0:1788844676.340505:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 177 00000100:00100000:0.0:1788844676.340604:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:11517:x1875739244837376:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788844676.340632:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844676.340664:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9e9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbcc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.340712:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.340730:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.340743:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.340874:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9e9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbcc expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.340896:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbcc expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.340905:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eee1796b00) 00010000:00010000:0.0:1788844676.340909:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788844676.340920:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030000, rc 0) 00000100:00100000:0.0:1788844676.341012:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:11517:x1875739244837376:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 496us (3650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844676.341020:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 177 00000100:00100000:0.0:1788844676.347761:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.350994:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244837632 00000100:00100000:3.0:1788844676.351017:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244837632 00000100:00100000:3.0:1788844676.351114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 178 00000100:00100000:3.0:1788844676.351128:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:11517:x1875739244837632:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788844676.351275:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.351297:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.351311:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788844676.351919:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788844676.351935:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390630397905ns, next at 391630393710ns, rc = 0 00000004:00010000:3.0:1788844676.352052:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003984377f reply state 00000000f73fd435 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844676.352064:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788844676.352224:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:11517:x1875739244837632:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 1095us (4475us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788844676.352241:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 178 00010000:00010000:3.0:1788844676.354887:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.354909:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.354917:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.354924:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844676.354929:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.354938:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.354958:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eee1796b00) 00010000:00010000:3.0:1788844676.354962:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788844676.354967:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.354974:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844676.355127:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.355506:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244837760 00000100:00100000:3.0:1788844676.355529:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244837760 00000100:00100000:3.0:1788844676.355631:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 179 00000100:00100000:3.0:1788844676.355743:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:11517:x1875739244837760:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844676.355775:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844676.355814:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9eb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbd3 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.355894:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbd3 expref: 25 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.355909:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbd3 expref: 25 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.355932:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eee1796b00) 00010000:00010000:3.0:1788844676.355935:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788844676.355938:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024e00, rc 0) 00000100:00100000:3.0:1788844676.356008:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:11517:x1875739244837760:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 366us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.356015:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 179 00000100:00100000:2.0:1788844676.366253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844676.366330:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244837888 00000100:00100000:2.0:1788844676.366345:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244837888 00000100:00100000:2.0:1788844676.367861:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:2.0:1788844676.367883:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244837888:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788844676.368341:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244837888:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 465us (2103us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788844676.368351:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00080000:2.0:1788844676.368383:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788844676.379211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.380700:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244838144 00000100:00100000:3.0:1788844676.380720:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244838144 00000100:00100000:3.0:1788844676.380800:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:3.0:1788844676.380810:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:11517:x1875739244838144:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788844676.381140:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:11517:x1875739244838144:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 329us (1944us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788844676.381158:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:1.0:1788844676.386726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844676.387873:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244838400 00000100:00100000:2.0:1788844676.387898:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244838400 00000100:00100000:2.0:1788844676.387973:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 180 00000100:00100000:2.0:1788844676.387984:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:11517:x1875739244838400:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788844676.388143:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:11517:x1875739244838400:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 159us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844676.388159:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 180 00000100:00100000:2.0:1788844676.393323:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.393616:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244838528 00000100:00100000:3.0:1788844676.393629:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244838528 00000100:00100000:3.0:1788844676.393819:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 181 00000100:00100000:3.0:1788844676.393832:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:11517:x1875739244838528:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844676.393859:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844676.393895:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbda expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.393985:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9ec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.394002:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.394015:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844676.394064:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844676.394090:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.394120:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9eba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbda expref: 28 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.394137:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbda expref: 27 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.394147:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eee1796b00) 00010000:00010000:3.0:1788844676.394159:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788844676.394163:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025600, rc 0) 00000100:00100000:3.0:1788844676.395010:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:11517:x1875739244838528:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1175us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.395022:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 181 00000100:00100000:1.0:1788844676.399921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.400018:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244838656 00000100:00100000:3.0:1788844676.400032:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244838656 00000100:00100000:3.0:1788844676.400136:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:3.0:1788844676.400157:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244838656:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844676.400181:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844676.400208:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9ec8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbe1 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788844676.400243:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9a83, blocks: 0x1 00010000:00010000:3.0:1788844676.400266:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1788844676.400271:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844676.400281:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9ec8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe1 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.400300:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9ec8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe1 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.400315:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025c00, rc 0) 00000100:00100000:3.0:1788844676.400392:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244838656:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 246us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.400400:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:1.0:1788844676.403044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.403141:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244838912 00000100:00100000:3.0:1788844676.403162:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244838912 00000100:00100000:3.0:1788844676.403277:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 182 00000100:00100000:3.0:1788844676.403288:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:11517:x1875739244838912:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788844676.403423:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:11517:x1875739244838912:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 136us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.403431:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 182 00000100:00100000:0.0:1788844676.409377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844676.409585:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244839040 00000100:00100000:2.0:1788844676.409600:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244839040 00000100:00100000:2.0:1788844676.409673:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:2.0:1788844676.409683:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:11517:x1875739244839040:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788844676.409706:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844676.409729:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbe8 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.409770:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9ec8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe1 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.409780:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844676.409797:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844676.409804:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.409851:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9ec8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe1 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.409881:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9ec8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe1 expref: 9 pid: 6688 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844676.409900:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875739267907328:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844676.410017:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed86cb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788844676.416498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.416893:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e23480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875739267907328:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844676.416937:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.416963:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65e00, rc 0) 00000100:00100000:3.0:1788844676.417032:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:11517:x1875739244839040:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 7350us (7671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.417042:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:0.0:1788844676.418161:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244839168 00000100:00100000:0.0:1788844676.418178:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244839168 00010000:00010000:0.0:1788844676.418232:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9ec8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe1 expref: 9 pid: 6688 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844676.418314:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:0.0:1788844676.418325:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d72850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2354:x1875739244839168:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844676.418343:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844676.418371:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9ec8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe1 expref: 9 pid: 6688 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.418385:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9ec8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe1 expref: 9 pid: 6688 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.418414:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9ec8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe1 expref: 9 pid: 6688 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.418431:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844676.418435:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844676.418457:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.418468:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.418566:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844676.418584:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefff1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1875739267907456:192.168.204.43@tcp:105: 00000100:00100000:0.0:1788844676.418790:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2f09240 going to sleep for 11 seconds 00000100:00100000:3.0:1788844676.421416:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefff1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1875739267907456:192.168.204.43@tcp:105: 00010000:00010000:3.0:1788844676.421455:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844676.421533:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d72850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244839168:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 3208us (5052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.421567:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:1.0:1788844676.425432:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844676.425524:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244839296 00000100:00100000:0.0:1788844676.425591:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244839296 00002000:00100000:0.0:1788844676.425666:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91edc1909c00 x1875739244839296/t0(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:537/0 lens 504/0 e 0 to 0 dl 1788844687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788844676.425680:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edc1909c00 with x1875739244839296 ext(0->8) 00002000:00010000:0.0:1788844676.425687:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91edc1909c00 00000100:00100000:0.0:1788844676.425719:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:0.0:1788844676.425733:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244839296:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788844676.426349:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:2354:x1875739244839296:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 Request processed in 618us (930us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788844676.426358:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00002000:00100000:0.0:1788844676.426367:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91edc1909c00 x1875739244839296/t4294967314(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:537/0 lens 504/448 e 0 to 0 dl 1788844687 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788844676.426376:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edc1909c00 with x1875739244839296 ext(0->8) 00002000:00010000:0.0:1788844676.426387:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91edc1909c00 00000100:00100000:0.0:1788844676.430501:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844676.430660:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244839424 00000100:00100000:2.0:1788844676.430673:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244839424 00000100:00100000:2.0:1788844676.430744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 183 00000100:00100000:2.0:1788844676.430756:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:11517:x1875739244839424:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 00000040:00080000:1.0:1788844676.513946:0:12453:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788844676.513963:0:12453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788844676.514020:0:12453:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788844676.514029:0:12453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788844676.517256:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:0.0:1788844676.517280:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788844676.517316:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1788844676.517489:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267907584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788844676.517881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844676.517972:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267907584 00000100:00100000:0.0:1788844676.517982:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267907584 00000100:00100000:0.0:1788844676.518049:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788844676.518060:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267907584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788844676.518281:0:7066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788844676.518286:0:7066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788844675 00002000:00010000:0.0:1788844676.518289:0:7066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788844676.518291:0:7066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788844675 -> 1788844675 00002000:00010000:0.0:1788844676.518294:0:7066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788844676.518342:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267907584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 283us (462us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788844676.518350:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788844676.518373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788844676.518411:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eeefff3800/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788844676.518419:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267907584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788844676.518577:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:11517:x1875739244839424:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 Request processed in 87820us (88089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844676.518586:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 183 00000020:00080000:1.0:1788844676.519736:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788844676.519757:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788844676.521508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.521766:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244839552 00000100:00100000:3.0:1788844676.521780:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244839552 00000100:00100000:3.0:1788844676.521847:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:3.0:1788844676.521859:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefcee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:2355:x1875739244839552:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788844676.618365:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1788844676.618383:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1788844676.619194:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefcee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244839552:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 Request processed in 97326us (97686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.619209:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:1.0:1788844676.623040:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844676.623475:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244839808 00000100:00100000:2.0:1788844676.623491:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244839808 00000100:00100000:2.0:1788844676.623613:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 184 00000100:00100000:2.0:1788844676.623625:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc190bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:11517:x1875739244839808:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788844676.623723:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844676.623762:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9ec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbda expref: 18 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.623787:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eee1796b00) 00010000:00010000:2.0:1788844676.623792:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788844676.623833:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.623850:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.623881:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788844676.624245:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010fa1632 reply state 00000000dcedd343 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844676.624257:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844676.624395:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc190bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:11517:x1875739244839808:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 771us (1368us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1788844676.624403:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 184 00000100:00100000:0.0:1788844676.627434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:3.0:1788844676.627874:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.627890:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.627899:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.627920:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844676.627925:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.627934:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.627955:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eee1796b00) 00010000:00010000:3.0:1788844676.627958:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844676.627963:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.627970:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2d9ed6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844676.628078:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244839936 00000100:00100000:1.0:1788844676.628092:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244839936 00000100:00100000:1.0:1788844676.628170:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:1.0:1788844676.628183:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244839936:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788844676.628525:0:7066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788844676.628530:0:7066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788844675 -> 1788844674 00002000:00010000:1.0:1788844676.628532:0:7066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788844671 00002000:00010000:1.0:1788844676.628727:0:7066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788844675 -> 1788844674 00002000:00010000:1.0:1788844676.628730:0:7066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788844676.628815:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2355:x1875739244839936:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 632us (1392us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788844676.628824:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:1.0:1788844676.634849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.634936:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244840192 00000100:00100000:3.0:1788844676.634950:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244840192 00000100:00100000:3.0:1788844676.635024:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 185 00000100:00100000:3.0:1788844676.635037:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc190b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+18:11517:x1875739244840192:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788844676.635157:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.635179:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbcc expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.635190:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.635238:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbcc expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.635265:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbcc expref: 18 pid: 5840 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844676.635283:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc2f85f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267907712:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844676.635416:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91edc12f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844676.640323:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844676.642631:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244840320 00000100:00100000:1.0:1788844676.642664:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244840320 00010000:00010000:1.0:1788844676.642737:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbcc expref: 19 pid: 5840 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844676.642792:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:1.0:1788844676.642804:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2354:x1875739244840320:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844676.642823:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844676.642841:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbcc expref: 19 pid: 5840 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.642858:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbcc expref: 19 pid: 5840 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.642890:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eee1796b00) 00010000:00010000:1.0:1788844676.642896:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.642926:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.642934:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.642960:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844676.643043:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2354:x1875739244840320:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 239us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844676.643050:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 69 00010000:00010000:2.0:1788844676.643648:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ea5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbcc expref: 18 pid: 5840 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844676.643670:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc2f85f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267907712:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844676.643704:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.643715:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.643722:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.643761:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.643768:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.643789:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.643796:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844676.643801:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.643810:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.643823:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eee1796b00) 00010000:00010000:2.0:1788844676.643826:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788844676.643831:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.643837:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9edd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844676.643906:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc190b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:11517:x1875739244840192:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 Request processed in 8872us (9085us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788844676.643916:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 185 00000100:00100000:0.0:1788844676.656350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844676.656440:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244840448 00000100:00100000:2.0:1788844676.656454:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244840448 00000100:00100000:2.0:1788844676.656530:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:2.0:1788844676.656565:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2355:x1875739244840448:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788844676.656625:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.656665:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.656686:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844676.656692:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788844676.656697:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.656742:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.656761:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 8 pid: 6686 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844676.656780:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875739267907840:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844676.656992:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed86cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788844676.672297:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.672532:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244840576 00000100:00100000:3.0:1788844676.672573:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244840576 00010000:00010000:3.0:1788844676.672642:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 9 pid: 6686 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844676.672692:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:3.0:1788844676.672704:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2355:x1875739244840576:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844676.672725:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844676.672758:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 9 pid: 6686 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.672777:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 9 pid: 6686 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.672812:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844676.672819:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844676.672827:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.672840:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.672887:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788844676.673085:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2d9ecf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbe8 expref: 9 pid: 6686 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844676.673106:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1875739267907840:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844676.673136:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.673158:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.673166:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.673195:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.673205:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.673214:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.673222:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65a00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844676.673227:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.673250:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.673264:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.673272:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2d9ee4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844676.675034:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2355:x1875739244840576:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 2319us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.675048:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:0.0:1788844676.677850:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244840448:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 Request processed in 21267us (21492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844676.677870:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:1.0:1788844676.684825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844676.685755:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244840832 00000100:00100000:2.0:1788844676.685772:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244840832 00000100:00100000:2.0:1788844676.685854:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 186 00000100:00100000:2.0:1788844676.685866:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc190b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+17:11517:x1875739244840832:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788844676.685973:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9eeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.685995:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9eeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.686008:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9eeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.686429:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.686443:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9eb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbd3 expref: 18 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.686452:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.686499:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbd3 expref: 18 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.686515:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9eb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbd3 expref: 18 pid: 8217 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844676.686532:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267907968:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844676.686684:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed86cb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788844676.696518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.696658:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244840960 00000100:00100000:3.0:1788844676.696672:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244840960 00010000:00010000:3.0:1788844676.696726:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9eb3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbd3 expref: 19 pid: 8217 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844676.696781:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:3.0:1788844676.696792:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2355:x1875739244840960:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844676.696812:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844676.696821:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9eb3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbd3 expref: 19 pid: 8217 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.696837:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9eb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbd3 expref: 19 pid: 8217 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.696866:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eee1796b00) 00010000:00010000:3.0:1788844676.696873:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.696884:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.696893:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.696934:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844676.697007:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2355:x1875739244840960:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 216us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844676.697017:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 71 00010000:00010000:0.0:1788844676.697233:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9eb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbd3 expref: 18 pid: 8217 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844676.697252:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267907968:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844676.697280:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.697289:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.697294:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788844676.697528:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788844676.698137:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1788844676.698206:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788844676.698316:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefff1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1875739267908096:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788844676.698387:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844676.698428:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec336ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788844676.698600:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267908096 00000100:00100000:2.0:1788844676.698609:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267908096 00000100:00100000:2.0:1788844676.698750:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788844676.698761:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1875739267908096:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788844676.698873:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1875739267908096:12345-0@lo:1000:mdt00_000.0 Request processed in 114us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844676.698881:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788844676.699896:0:5838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788844676.699909:0:5838:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eeefff3800, transno 4294967315 00000100:00100000:0.0:1788844676.699932:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefff1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1875739267908096:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788844676.700508:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1788844676.701312:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefff1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1875739267908224:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788844676.701392:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844676.701434:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec336c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788844676.701835:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267908224 00000100:00100000:2.0:1788844676.701847:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267908224 00000100:00100000:2.0:1788844676.702122:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788844676.702134:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1875739267908224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788844676.702412:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1875739267908224:12345-0@lo:1000:mdt00_000.0 Request processed in 278us (1017us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788844676.702421:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788844676.702533:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefff1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1875739267908224:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788844676.702622:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702636:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702645:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702658:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844676.702663:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702671:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702692:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eee1796b00) 00010000:00010000:1.0:1788844676.702702:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788844676.702711:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702718:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9ef2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702763:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702770:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e2e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702777:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702783:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844676.702787:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702794:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e2e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702803:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8f00) 00010000:00010000:1.0:1788844676.702805:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788844676.702809:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e2e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702815:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9e2e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702845:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702876:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb7 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702887:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.702930:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb7 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844676.703677:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb7 expref: 21 pid: 5839 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844676.703700:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc1908000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267908352:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844676.704029:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844676.715302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844676.715342:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244841088 00000100:00100000:0.0:1788844676.715355:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244841088 00010000:00010000:0.0:1788844676.715406:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb7 expref: 22 pid: 5839 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844676.715457:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 72 00000100:00100000:0.0:1788844676.715469:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:2354:x1875739244841088:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844676.715491:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844676.715499:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb7 expref: 22 pid: 5839 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.715531:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb7 expref: 22 pid: 5839 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.715580:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8f00) 00010000:00010000:0.0:1788844676.715600:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.715613:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.715623:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844676.715656:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844676.715729:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:2354:x1875739244841088:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 262us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844676.715736:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 72 00010000:00010000:3.0:1788844676.716518:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2d9e4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbb7 expref: 21 pid: 5839 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844676.716566:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc1908000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267908352:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844676.716594:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716605:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716611:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716626:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716792:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716802:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716809:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844676.716813:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716846:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716859:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8f00) 00010000:00010000:3.0:1788844676.716862:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844676.716867:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716873:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2d9ef9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716885:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9eeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716890:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9eeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716895:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9eeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716900:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844676.716903:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9eeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716908:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9eeb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716914:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8f00) 00010000:00010000:3.0:1788844676.716916:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788844676.716918:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9eeb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.716933:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9eeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844676.717242:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc190b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11517:x1875739244840832:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 31376us (32427us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1788844676.717252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 186 00000020:00080000:3.0:1788844676.717258:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788844676.718320:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788844676.718329:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788844676.719038:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788844676.719052:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788844676.723044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844676.723278:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244841344 00000100:00100000:3.0:1788844676.723293:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244841344 00000100:00100000:3.0:1788844676.723365:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:3.0:1788844676.723377:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11517:x1875739244841344:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788844676.724747:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788844676.724877:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1788844676.724946:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.724970:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.724987:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.724999:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.725006:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.725013:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844676.725045:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788844676.725194:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:11517:x1875739244841344:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 1813us (2162us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788844676.725204:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 50 00000020:00080000:2.0:1788844676.725220:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788844676.725370:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844676.725379:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.725387:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844676.725392:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.725401:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.725417:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91eec2f43700) 00010000:00010000:3.0:1788844676.725421:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788844676.725426:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.725431:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2d9f00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844676.725464:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844676.725466:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844676.725467:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844677.306994:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788844677.977385:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:1.0:1788844678.082925:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844678.082978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844678.083016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844678.083034:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844678.083065:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844678.083098:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244841984 00000100:00100000:1.0:1788844678.083106:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244841984 00000100:00100000:1.0:1788844678.083168:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244841600 00000100:00100000:1.0:1788844678.083171:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244841600 00000100:00100000:1.0:1788844678.083196:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 179 00000100:00100000:1.0:1788844678.083205:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc190ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244841984:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844678.083281:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc190ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244841984:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844678.083306:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 179 00000100:00100000:1.0:1788844678.083323:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 180 00000100:00100000:1.0:1788844678.083330:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:2354:x1875739244841600:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844678.083361:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:2354:x1875739244841600:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844678.083367:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 180 00000100:00100000:1.0:1788844678.083386:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244841728 00000100:00100000:1.0:1788844678.083389:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244841728 00000100:00100000:1.0:1788844678.083411:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244841856 00000100:00100000:1.0:1788844678.083414:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244841856 00000100:00100000:1.0:1788844678.083432:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 103 00000100:00100000:1.0:1788844678.083438:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244841728:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844678.083464:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244841728:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 26us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844678.083470:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 103 00000100:00100000:1.0:1788844678.083481:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:1.0:1788844678.083491:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244841856:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844678.083512:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244841856:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844678.083518:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:3.0:1788844678.084382:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244841472 00000100:00100000:3.0:1788844678.084393:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244841472 00000100:00080000:0.0:1788844678.084480:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844678.084486:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844678.084489:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844678.084726:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 307 00000100:00100000:3.0:1788844678.084746:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244841472:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844678.084843:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244841472:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 104us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844678.084852:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 307 00010000:00010000:3.0:1788844678.330905:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844678.393983:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267908480:0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.394055:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844678.394102:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267908992:0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.394139:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844678.394167:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788844678.394173:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267908608:0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.394198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844678.394215:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267909120:0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.394235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844678.394267:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267908480 00000100:00100000:3.0:1788844678.394274:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267908480 00000100:00100000:3.0:1788844678.394317:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788844678.394326:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267908480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.394374:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267908480:12345-0@lo:400:kworker.0 Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844678.394390:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788844678.394935:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267908992 00000100:00100000:3.0:1788844678.394942:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267908992 00000100:00100000:3.0:1788844678.394992:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267908608 00000100:00100000:3.0:1788844678.394995:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267908608 00000100:00100000:3.0:1788844678.395014:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788844678.395020:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267908992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.395058:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875739267908992:12345-0@lo:400:kworker.0 Request processed in 38us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844678.395064:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788844678.395076:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788844678.395082:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267908608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.395119:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267908608:12345-0@lo:400:kworker.0 Request processed in 27us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844678.395124:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788844678.395149:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267909120 00000100:00100000:3.0:1788844678.395153:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267909120 00000100:00100000:3.0:1788844678.395180:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788844678.395186:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267909120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.395217:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267909120:12345-0@lo:400:kworker.0 Request processed in 32us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844678.395223:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788844678.395262:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267908608:0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.395271:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788844678.395276:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1788844678.395295:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eeff8b2680, transno 4294967307 00000100:00100000:3.0:1788844678.395313:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267909120:0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.395324:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267908480:0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.395333:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267908992:0@lo:400:kworker.0 00000100:00080000:3.0:1788844678.395361:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788844678.395365:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844678.396141:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267908864:0@lo:400:kworker.0 00000100:00100000:0.0:1788844678.396185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844678.396218:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788844678.396224:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267908736:0@lo:400:kworker.0 00000100:00100000:0.0:1788844678.396247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844678.398627:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267908864 00000100:00100000:3.0:1788844678.398643:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267908864 00000100:00100000:3.0:1788844678.398709:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788844678.398730:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267908864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.399249:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267908864:12345-0@lo:400:kworker.0 Request processed in 531us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844678.399259:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788844678.399285:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267908736 00000100:00100000:3.0:1788844678.399290:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267908736 00000100:00100000:3.0:1788844678.399321:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788844678.399328:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267908736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.399366:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875739267908736:12345-0@lo:400:kworker.0 Request processed in 39us (3117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844678.399372:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:3.0:1788844678.399389:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788844678.399393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844678.399445:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875739267908736:0@lo:400:kworker.0 00000100:00100000:3.0:1788844678.399460:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267908864:0@lo:400:kworker.0 00000040:00080000:3.0:1788844678.566304:0:12508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788844678.566314:0:12508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788844678.566363:0:12508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788844678.566369:0:12508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788844678.717229:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844678.717320:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244842240 00000100:00100000:0.0:1788844678.717331:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244842240 00000100:00100000:0.0:1788844678.717393:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 187 00000100:00100000:0.0:1788844678.717404:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:11536:x1875739244842240:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1788844678.717437:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844678.717460:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844678.717590:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9f0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844678.717606:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9f0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844678.717617:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9f0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844678.717628:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788844678.717758:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbef expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844678.717776:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9f0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbef expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844678.717785:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:0.0:1788844678.717788:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788844678.717792:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030600, rc 0) 00000100:00100000:0.0:1788844678.717865:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:11536:x1875739244842240:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 462us (645us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788844678.717873:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 187 00000100:00100000:0.0:1788844678.721288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844678.721364:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244842368 00000100:00100000:3.0:1788844678.721375:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244842368 00000100:00100000:3.0:1788844678.721441:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 188 00000100:00100000:3.0:1788844678.721453:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:11536:x1875739244842368:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:3.0:1788844678.721573:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.721592:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.721613:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.721629:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.721636:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.721643:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722168:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722178:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722186:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788844678.722233:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722247:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722252:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722258:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722264:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844678.722269:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722277:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722289:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844678.722292:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844678.722297:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722303:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722316:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722321:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722333:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722339:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844678.722341:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722348:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722356:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eed03a8700) 00010000:00010000:3.0:1788844678.722358:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844678.722360:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722365:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722380:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722386:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722403:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722409:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844678.722412:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722428:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722438:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8f00) 00010000:00010000:3.0:1788844678.722440:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844678.722443:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.722448:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844678.724081:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:11536:x1875739244842368:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 2621us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844678.724096:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 188 00000100:00100000:3.0:1788844678.788963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844678.788996:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244842624 00000100:00100000:3.0:1788844678.789006:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244842624 00000100:00100000:3.0:1788844678.789056:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 189 00000100:00100000:3.0:1788844678.789066:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:11539:x1875739244842624:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844678.789087:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844678.789119:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbf6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.789196:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.789211:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.789240:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.789255:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.789263:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.789270:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.789567:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.789576:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.789584:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844678.791922:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788844678.792079:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792091:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792099:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792114:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844678.792128:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792137:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792154:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844678.792157:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844678.792162:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792169:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2d9f38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792182:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792187:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792192:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792198:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844678.792200:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792206:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792213:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eed03a8f00) 00010000:00010000:3.0:1788844678.792216:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844678.792226:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792232:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2d9f3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792291:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2d9f31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbf6 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792307:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbf6 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.792314:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:3.0:1788844678.792317:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844678.792319:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025600, rc 0) 00000100:00100000:3.0:1788844678.796097:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:11539:x1875739244842624:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 7019us (7130us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788844678.796119:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 189 00000100:00100000:0.0:1788844678.801958:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844678.802053:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244842752 00000100:00100000:3.0:1788844678.802063:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244842752 00000100:00100000:3.0:1788844678.802161:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 190 00000100:00100000:3.0:1788844678.802172:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:11539:x1875739244842752:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:3.0:1788844678.802239:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.802256:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.802267:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.802314:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.802320:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9f54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.802327:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.802333:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844678.802338:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.802346:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.802360:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:3.0:1788844678.802363:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844678.802367:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9f54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.802373:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2d9f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844678.803228:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:11539:x1875739244842752:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 1053us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844678.803238:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 190 00000100:00100000:0.0:1788844678.807823:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844678.808037:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244843008 00000100:00100000:1.0:1788844678.808048:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244843008 00000100:00100000:1.0:1788844678.808116:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:1.0:1788844678.808126:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+26:11539:x1875739244843008:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844678.808368:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:11539:x1875739244843008:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 241us (563us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788844678.808376:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:3.0:1788844678.864369:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844678.864617:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244843264 00000100:00100000:2.0:1788844678.864629:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244843264 00000100:00100000:2.0:1788844678.864692:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 191 00000100:00100000:2.0:1788844678.864713:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:11063:x1875739244843264:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1788844678.864741:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844678.864769:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9f5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fbfd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.864877:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.864897:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbf6 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.864908:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.864939:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbf6 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.864952:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbf6 expref: 28 pid: 5838 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844678.864984:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267909248:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844678.865073:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec7050240 going to sleep for 11 seconds 00000100:00100000:2.0:1788844678.871913:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267909248:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844678.871942:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844678.876965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844678.877142:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244843392 00000100:00100000:2.0:1788844678.877152:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244843392 00010000:00010000:2.0:1788844678.877196:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbf6 expref: 29 pid: 5838 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844678.877239:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00100000:2.0:1788844678.877248:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:2355:x1875739244843392:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844678.877264:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844678.877270:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbf6 expref: 29 pid: 5838 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.877292:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbf6 expref: 29 pid: 5838 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.877313:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025600/0x7f1093851e2d9f46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbf6 expref: 29 pid: 5838 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.877330:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:2.0:1788844678.877336:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.877358:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.877365:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844678.877403:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844678.877461:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+28:2355:x1875739244843392:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 213us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844678.877469:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 73 00010000:00010000:3.0:1788844678.878986:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.879001:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844678.879042:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788844678.879206:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2d9f5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbfd expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.879225:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbfd expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.879234:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:3.0:1788844678.879237:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788844678.879241:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65200, rc 0) 00000100:00100000:3.0:1788844678.879600:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+28:11063:x1875739244843264:12345-192.168.204.43@tcp:101:bash.0 Request processed in 14888us (15236us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788844678.879611:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 191 00000100:00100000:3.0:1788844678.890088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844678.890197:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244843648 00000100:00100000:0.0:1788844678.890208:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244843648 00000100:00100000:0.0:1788844678.890269:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 192 00000100:00100000:0.0:1788844678.890279:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+28:11063:x1875739244843648:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:1.0:1788844678.892234:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844678.892257:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844678.892268:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788844678.893614:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1788844678.893668:0:8217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcea504a reply state 000000007a2829e3 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844678.893680:0:8217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788844678.893762:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1788844678.893897:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:11063:x1875739244843648:12345-192.168.204.43@tcp:36:bash.0 Request processed in 3614us (3814us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788844678.893906:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 192 00000020:00080000:1.0:1788844678.893912:0:8217:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788844678.899373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:3.0:1788844678.899631:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.899645:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.899652:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.899658:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844678.899663:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.899671:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.899709:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:3.0:1788844678.899713:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844678.899717:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.899723:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2d9f70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844678.900035:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244843776 00000100:00100000:1.0:1788844678.900045:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244843776 00000100:00100000:1.0:1788844678.900114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 193 00000100:00100000:1.0:1788844678.900124:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:11063:x1875739244843776:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1788844678.900146:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844678.900163:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9f77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844678.900233:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9f77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc04 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844678.900247:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9f77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc04 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844678.900266:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:1.0:1788844678.900268:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788844678.900272:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60200, rc 0) 00000100:00100000:1.0:1788844678.900415:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:11063:x1875739244843776:12345-192.168.204.43@tcp:101:bash.0 Request processed in 291us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844678.900422:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 193 00000100:00100000:1.0:1788844678.907739:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267909376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788844678.907833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844678.907914:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267909376 00000100:00100000:2.0:1788844678.907923:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267909376 00000100:00100000:2.0:1788844678.907985:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788844678.907994:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc190aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267909376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788844678.908033:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844678.908088:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc190aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267909376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844678.908095:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788844678.909614:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844678.909695:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244843904 00000100:00100000:3.0:1788844678.909703:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244843904 00000100:00100000:3.0:1788844678.909751:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:3.0:1788844678.909761:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed829b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:11063:x1875739244843904:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844678.909776:0:7066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844678.909797:0:7066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9f7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc0b expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788844678.909837:0:7066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9a82, atime: 0x6a9f9a7f, ctime: 0x6a9f9a82, blocks: 0xb 00010000:00010000:3.0:1788844678.909860:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1788844678.909865:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844678.909874:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc0b expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.909892:0:7066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc0b expref: 8 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844678.909911:0:7066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025c00, rc 0) 00000100:00100000:3.0:1788844678.909978:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed829b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:11063:x1875739244843904:12345-192.168.204.43@tcp:101:bash.0 Request processed in 218us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844678.909999:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:1.0:1788844678.910189:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267909376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844678.915260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844678.915503:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244844032 00000100:00100000:1.0:1788844678.915515:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244844032 00002000:00010000:1.0:1788844678.915708:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788844678.915714:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eed8299500 with x1875739244844032 ext(0->18446744073709551615) 00002000:00010000:1.0:1788844678.915727:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eed8299500. 00000100:00100000:1.0:1788844678.915798:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:1.0:1788844678.915819:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244844032:12345-192.168.204.43@tcp:10:bash.0 00002000:00010000:1.0:1788844678.916118:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788844678.916122:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788844674 -> 1788844678 00002000:00010000:1.0:1788844678.916139:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788844671 -> 1788844671 00002000:00010000:1.0:1788844678.916141:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788844674 -> 1788844678 00002000:00010000:1.0:1788844678.916144:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788844678.916211:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2354:x1875739244844032:12345-192.168.204.43@tcp:10:bash.0 Request processed in 404us (961us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788844678.916220:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00002000:00010000:1.0:1788844678.916223:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788844678.916227:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eed8299500 with x1875739244844032 ext(0->18446744073709551615) 00002000:00010000:1.0:1788844678.916232:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eed8299500. 00000100:00100000:2.0:1788844679.046369:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844679.047274:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244844160 00000100:00100000:0.0:1788844679.047288:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244844160 00000100:00100000:0.0:1788844679.047414:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 194 00000100:00100000:0.0:1788844679.047425:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:11553:x1875739244844160:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:0.0:1788844679.047506:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9f85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.047525:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.047564:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.047581:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.047595:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.047602:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048044:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048062:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048069:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788844679.048122:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048134:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048141:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9f85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048148:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048154:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844679.048158:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048165:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9f85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048176:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:0.0:1788844679.048180:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844679.048184:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9f85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048190:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9f85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048211:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048216:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9f8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048221:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048226:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844679.048229:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048236:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9f8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048243:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eee1796100) 00010000:00010000:0.0:1788844679.048246:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844679.048249:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9f8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048254:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9f8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048268:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048274:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048280:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048291:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844679.048294:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048300:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048307:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:0.0:1788844679.048310:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844679.048313:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.048319:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2d9f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844679.048782:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:11553:x1875739244844160:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 1355us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844679.048791:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 194 00000100:00100000:2.0:1788844679.135907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.136151:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244844416 00000100:00100000:1.0:1788844679.136161:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244844416 00000100:00100000:1.0:1788844679.136223:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 195 00000100:00100000:1.0:1788844679.136234:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:11556:x1875739244844416:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844679.136255:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844679.136277:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9f9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136350:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fa1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136365:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136377:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136405:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136430:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136438:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136743:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9faf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136753:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136761:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844679.136770:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788844679.136870:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136879:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fa1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136885:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fa1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136891:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844679.136895:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fa1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136902:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fa1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136925:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:1.0:1788844679.136927:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844679.136932:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fa1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136938:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fa1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136951:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136957:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136963:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136976:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844679.136979:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136985:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.136993:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eec7351700) 00010000:00010000:1.0:1788844679.136995:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844679.136998:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fa8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.137004:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.137054:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2d9f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc12 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.137069:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9faf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc12 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.137077:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:1.0:1788844679.137079:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788844679.137081:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60400, rc 0) 00000100:00100000:1.0:1788844679.137154:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:11556:x1875739244844416:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 922us (1255us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788844679.137162:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 195 00000100:00100000:3.0:1788844679.144756:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.144940:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244844544 00000100:00100000:1.0:1788844679.144950:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244844544 00000100:00100000:1.0:1788844679.145020:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 196 00000100:00100000:1.0:1788844679.145029:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:11556:x1875739244844544:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:1.0:1788844679.145103:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.145121:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbfd expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.145131:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.145718:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbfd expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.145759:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbfd expref: 34 pid: 5840 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844679.145773:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc190a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267909504:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844679.150430:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed0389240 going to sleep for 11 seconds 00000100:00100000:1.0:1788844679.159855:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc190a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267909504:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844679.159893:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844679.160432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.161413:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244844800 00000100:00100000:1.0:1788844679.161426:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244844800 00000100:00100000:1.0:1788844679.161499:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:1.0:1788844679.161509:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:5596:x1875739244844800:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788844679.162303:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+36:5596:x1875739244844800:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 791us (1867us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788844679.162313:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:2.0:1788844679.167778:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844679.168219:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244844928 00000100:00100000:0.0:1788844679.168230:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244844928 00010000:00010000:0.0:1788844679.168284:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbfd expref: 36 pid: 5840 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844679.168333:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:0.0:1788844679.168343:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+36:2354:x1875739244844928:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844679.168360:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844679.168367:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbfd expref: 36 pid: 5840 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.168923:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbfd expref: 36 pid: 5840 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.168946:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2d9f62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbfd expref: 36 pid: 5840 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.168964:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:0.0:1788844679.168981:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.168991:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.168998:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.169271:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844679.169352:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:2354:x1875739244844928:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1006us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844679.169359:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 74 00010000:00010000:3.0:1788844679.176489:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.176508:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.176644:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.176653:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.176661:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.176671:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844679.176676:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.176684:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.176706:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:3.0:1788844679.176709:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844679.176714:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.176719:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844679.177052:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:11556:x1875739244844544:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 32017us (32306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844679.177063:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 196 00000100:00100000:2.0:1788844679.193008:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.193124:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244845184 00000100:00100000:1.0:1788844679.193135:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244845184 00000100:00100000:1.0:1788844679.193189:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:1.0:1788844679.193201:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+34:11556:x1875739244845184:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844679.193444:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:11556:x1875739244845184:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 244us (455us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788844679.193452:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00010000:00010000:1.0:1788844679.353823:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844679.397369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.397493:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244845440 00000100:00100000:1.0:1788844679.397505:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244845440 00000100:00100000:1.0:1788844679.397602:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 197 00000100:00100000:1.0:1788844679.397613:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+35:11567:x1875739244845440:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:1.0:1788844679.397637:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844679.397662:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc19 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.397738:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fcb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.397753:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.397765:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.397779:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9fd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.397786:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.397792:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398059:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398068:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398086:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844679.398106:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788844679.398198:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398206:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fcb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398212:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398218:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844679.398222:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398230:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398242:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:1.0:1788844679.398244:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844679.398249:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398254:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2d9fcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398265:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398271:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398282:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398287:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844679.398290:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398297:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398305:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eec7351700) 00010000:00010000:1.0:1788844679.398307:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844679.398310:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9fd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398316:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2d9fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398356:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2d9fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc19 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398370:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc19 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.398377:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:1.0:1788844679.398380:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844679.398382:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60a00, rc 0) 00000100:00100000:1.0:1788844679.398449:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:11567:x1875739244845440:12345-192.168.204.43@tcp:101:cat.0 Request processed in 838us (1091us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788844679.398465:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 197 00000100:00100000:3.0:1788844679.413728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.413864:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244845696 00000100:00100000:1.0:1788844679.413889:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244845696 00000100:00100000:1.0:1788844679.413971:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:1.0:1788844679.413983:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:11567:x1875739244845696:12345-192.168.204.43@tcp:35:cat.0 00000100:00100000:1.0:1788844679.414326:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+38:11567:x1875739244845696:12345-192.168.204.43@tcp:35:cat.0 Request processed in 344us (616us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788844679.414334:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 54 00000100:00100000:1.0:1788844679.418482:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844679.419249:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267909632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844679.419611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844679.419691:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267909632 00000100:00100000:2.0:1788844679.419704:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267909632 00000100:00100000:2.0:1788844679.419866:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788844679.419881:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc190a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875739267909632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844679.419885:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788844679.419898:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1788844679.419931:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844679.420577:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc190a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875739267909632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 696us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844679.420609:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267909632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844679.420652:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788844679.453727:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844679.454112:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244845952 00000100:00100000:0.0:1788844679.454131:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244845952 00000100:00100000:0.0:1788844679.454259:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 198 00000100:00100000:0.0:1788844679.454274:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+38:11568:x1875739244845952:12345-192.168.204.43@tcp:36:rm.0 00010000:00010000:0.0:1788844679.454367:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788844679.454491:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2d9fd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc19 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.454589:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60400/0x7f1093851e2d9faf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc12 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.454608:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60200/0x7f1093851e2d9f77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc04 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.454622:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eed03a8700) 00010000:00010000:0.0:1788844679.454638:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788844679.454675:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9fe7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.454694:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.454716:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.454735:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.455275:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.455286:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.457481:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ff5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.457516:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ff5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.457530:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ff5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788844679.460509:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788844679.460527:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393738989822ns, next at 394738985858ns, rc = 0 00010000:00010000:0.0:1788844679.460649:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460686:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460699:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460711:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460719:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460726:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460760:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844679.460792:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ff5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460799:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ff5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460815:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ff5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460822:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844679.460826:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ff5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460835:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ff5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460853:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796200) 00010000:00010000:0.0:1788844679.460857:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788844679.460863:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ff5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460870:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2d9ff5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460897:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460904:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9fe7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460910:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9fe7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460915:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844679.460918:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9fe7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460933:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9fe7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460941:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:0.0:1788844679.460944:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844679.460947:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9fe7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.460953:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2d9fe7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788844679.460963:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba9d2d04 reply state 00000000f99c5886 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844679.460973:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788844679.461430:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844679.461440:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.461449:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844679.461454:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.461463:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.461475:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91eee1796200) 00010000:00010000:3.0:1788844679.461478:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788844679.461482:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.461489:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2d9ffc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.461510:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844679.461512:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844679.461514:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844679.462220:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+37:11568:x1875739244845952:12345-192.168.204.43@tcp:36:rm.0 Request processed in 7936us (8506us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788844679.462236:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 198 00010000:00010000:3.0:1788844679.466963:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.466988:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.467022:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.467030:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844679.467037:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.467047:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.467070:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eee1796100) 00010000:00010000:3.0:1788844679.467074:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844679.467079:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.467086:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2d9fee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844679.520142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.520682:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244846208 00000100:00100000:1.0:1788844679.520708:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244846208 00000100:00100000:1.0:1788844679.521024:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 199 00000100:00100000:1.0:1788844679.521040:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+36:11574:x1875739244846208:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1788844679.521073:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844679.521113:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da003 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.521294:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da00a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.521313:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da00a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.521356:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da00a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.521642:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.521968:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.521979:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788844679.523268:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788844679.527256:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527287:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527304:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527360:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da00a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527369:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da00a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527390:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da00a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527397:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844679.527424:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da00a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527433:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da00a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527451:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:1.0:1788844679.527464:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844679.527471:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da00a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527479:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da00a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788844679.527500:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c95d4a5 reply state 0000000053ab954b transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844679.527511:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788844679.527639:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da003 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc20 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527669:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc20 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.527678:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:1.0:1788844679.527681:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844679.527684:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60c00, rc 0) 00000100:00100000:0.0:1788844679.537800:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+39:11574:x1875739244846208:12345-192.168.204.43@tcp:101:bash.0 Request processed in 16744us (17655us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788844679.537819:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 199 00000100:00100000:0.0:1788844679.546368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.547570:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244846336 00000100:00100000:1.0:1788844679.547599:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244846336 00000100:00100000:1.0:1788844679.547689:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:1.0:1788844679.547830:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2356:x1875739244846336:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1788844679.547876:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844679.547906:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4ed8fd6/0x7f1093851e2da026 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc27 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788844679.547943:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844679.547971:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1788844679.547977:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844679.547990:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ed8fd6/0x7f1093851e2da026 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc27 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.548013:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4ed8fd6/0x7f1093851e2da026 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc27 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.548031:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61a00, rc 0) 00000100:00100000:1.0:1788844679.548126:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2356:x1875739244846336:12345-192.168.204.43@tcp:101:bash.0 Request processed in 426us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844679.548134:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 61 00010000:00010000:3.0:1788844679.548387:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.548398:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.548407:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.548414:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61400 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844679.548420:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.548442:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.548460:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eec7351700) 00010000:00010000:3.0:1788844679.548463:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844679.548469:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.548476:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da011 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844679.553068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844679.553158:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244846464 00000100:00100000:3.0:1788844679.553171:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244846464 00000100:00100000:3.0:1788844679.553239:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:3.0:1788844679.553249:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:11574:x1875739244846464:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844679.553272:0:7066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844679.553295:0:7066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc2e expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.553335:0:7066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4ed8fd6/0x7f1093851e2da026 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc27 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.553345:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844679.553350:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844679.553357:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.553414:0:7066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4ed8fd6/0x7f1093851e2da026 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc27 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.553462:0:7066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4ed8fd6/0x7f1093851e2da026 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc27 expref: 7 pid: 6687 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844679.553481:0:7066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc2f85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7066:1875739267909760:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844679.553668:0:7066:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed86cb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844679.561219:0:7066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc2f85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7066:1875739267909760:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844679.561273:0:7066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 7 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.561304:0:7066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:3.0:1788844679.561455:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:11574:x1875739244846464:12345-192.168.204.43@tcp:101:bash.0 Request processed in 8198us (8392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844679.561468:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:1.0:1788844679.580165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844679.581674:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244846592 00000100:00100000:0.0:1788844679.581694:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244846592 00010000:00010000:0.0:1788844679.581778:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ed8fd6/0x7f1093851e2da026 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc27 expref: 7 pid: 6687 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844679.581837:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:0.0:1788844679.581871:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244846592:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844679.581893:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844679.581927:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4ed8fd6/0x7f1093851e2da026 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc27 expref: 7 pid: 6687 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.581947:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4ed8fd6/0x7f1093851e2da026 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc27 expref: 7 pid: 6687 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.581976:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4ed8fd6/0x7f1093851e2da026 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc27 expref: 7 pid: 6687 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.582001:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844679.582007:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844679.582019:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 6 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.582032:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 6 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.582103:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 6 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844679.582124:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875739267909888:192.168.204.43@tcp:105: 00000100:00100000:0.0:1788844679.582261:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec1377540 going to sleep for 11 seconds 00000100:00100000:0.0:1788844679.588467:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1875739267909888:192.168.204.43@tcp:105: 00010000:00010000:0.0:1788844679.588533:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844679.588658:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2355:x1875739244846592:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 6788us (8509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844679.588674:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:3.0:1788844679.590409:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.590485:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244846848 00000100:00100000:1.0:1788844679.590498:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244846848 00000100:00100000:1.0:1788844679.590617:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:1.0:1788844679.590629:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+38:11574:x1875739244846848:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:1.0:1788844679.591330:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+39:11574:x1875739244846848:12345-192.168.204.43@tcp:35:bash.0 Request processed in 700us (930us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788844679.591341:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 55 00000100:00100000:1.0:1788844679.800223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844679.800386:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244846976 00000100:00100000:3.0:1788844679.800408:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244846976 00000100:00100000:3.0:1788844679.800502:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 200 00000100:00100000:3.0:1788844679.800515:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+39:11590:x1875739244846976:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844679.800588:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844679.800620:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc35 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.800732:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.800797:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.800815:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844679.800868:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788844679.800872:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844679.800896:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.800929:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc35 expref: 41 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.800952:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc35 expref: 40 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.800964:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844679.800967:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788844679.800971:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024e00, rc 0) 00000100:00100000:3.0:1788844679.801055:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+40:11590:x1875739244846976:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 543us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844679.801063:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 200 00000100:00100000:0.0:1788844679.809206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844679.809612:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244847232 00000100:00100000:3.0:1788844679.809628:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244847232 00000100:00100000:3.0:1788844679.809703:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 201 00000100:00100000:3.0:1788844679.809714:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+40:11590:x1875739244847232:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844679.810001:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844679.810039:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da042 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc3c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.810194:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.810213:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.810226:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844679.810240:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788844679.810420:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da042 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc3c expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.810441:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc3c expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.810451:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:3.0:1788844679.810454:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844679.810459:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025200, rc 0) 00000100:00100000:3.0:1788844679.810921:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+42:11590:x1875739244847232:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1207us (1729us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788844679.810932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 201 00000100:00100000:2.0:1788844679.818312:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844679.818371:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844679.818467:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244847360 00000100:00100000:0.0:1788844679.818482:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244847360 00000100:00100000:0.0:1788844679.818607:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1788844679.818620:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+42:2355:x1875739244847360:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844679.818644:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844679.818681:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc3c expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.818706:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:0.0:1788844679.818712:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844679.818919:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+41:2355:x1875739244847360:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 300us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844679.818927:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:3.0:1788844679.819434:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244847616 00000100:00100000:3.0:1788844679.819502:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244847616 00000100:00100000:3.0:1788844679.819577:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 202 00000100:00100000:3.0:1788844679.819586:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+41:11590:x1875739244847616:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844679.819638:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844679.819674:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da057 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc43 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.821028:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da05e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.821055:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da05e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.821069:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da05e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844679.821095:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788844679.821289:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da057 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc43 expref: 44 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.821308:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da05e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc43 expref: 43 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.821317:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:3.0:1788844679.821321:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788844679.821325:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844679.821409:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+43:11590:x1875739244847616:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1823us (3036us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788844679.821419:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 202 00000100:00100000:2.0:1788844679.833513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.833758:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244847744 00000100:00100000:1.0:1788844679.833772:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244847744 00000100:00100000:1.0:1788844679.834005:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:1.0:1788844679.834019:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+6:2354:x1875739244847744:12345-192.168.204.43@tcp:1:lfs.0 00010000:00010000:1.0:1788844679.834102:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.834130:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 6 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.834140:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788844679.834145:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788844679.834151:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.834202:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 6 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.834218:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 6 pid: 7066 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844679.834235:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc1909880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875739267910016:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844679.834371:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed0389480 going to sleep for 11 seconds 00000100:00100000:3.0:1788844679.838731:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc1909880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875739267910016:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844679.838775:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844679.839053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844679.839369:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244847872 00000100:00100000:3.0:1788844679.839379:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244847872 00002000:00100000:3.0:1788844679.839440:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91edc1909880 x1875739244847872/t0(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:540/0 lens 504/0 e 0 to 0 dl 1788844690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788844679.839460:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edc1909880 with x1875739244847872 ext(0->8) 00010000:00010000:3.0:1788844679.839469:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 7 pid: 7066 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.839485:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 7 pid: 7066 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788844679.839493:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91edc1909880 00000100:00100000:3.0:1788844679.839533:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:3.0:1788844679.839582:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244847872:12345-192.168.204.43@tcp:4:lfs.0 00000100:00100000:3.0:1788844679.840293:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2354:x1875739244847872:12345-192.168.204.43@tcp:4:lfs.0 Request processed in 719us (1238us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788844679.840304:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00002000:00100000:3.0:1788844679.840312:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91edc1909880 x1875739244847872/t4294967308(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:540/0 lens 504/448 e 0 to 0 dl 1788844690 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788844679.840323:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edc1909880 with x1875739244847872 ext(0->8) 00010000:00010000:3.0:1788844679.840330:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 9 pid: 7066 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.840358:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 9 pid: 7066 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788844679.840366:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91edc1909880 00000100:00100000:3.0:1788844679.854433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844679.859752:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244848000 00000100:00100000:0.0:1788844679.859775:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244848000 00010000:00010000:0.0:1788844679.860630:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 9 pid: 7066 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844679.860700:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:0.0:1788844679.860712:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2356:x1875739244848000:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844679.860734:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788844679.861000:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788844679.861004:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788844678 00002000:00010000:0.0:1788844679.861007:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788844679 00002000:00010000:0.0:1788844679.861009:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788844678 00010000:00010000:0.0:1788844679.861018:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 9 pid: 7066 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.861036:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 9 pid: 7066 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.861069:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050073eca/0x7f1093851e2da02d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc2e expref: 9 pid: 7066 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.861102:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788844679.861107:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788844679.861114:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.861125:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.861162:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844679.861347:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2356:x1875739244848000:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 637us (6933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844679.861356:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 76 00010000:00010000:1.0:1788844679.862357:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.862396:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.862438:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.862457:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.862466:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.862474:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844679.862481:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.862492:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.862510:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.862519:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d34939/0x7f1093851e2da06c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844679.862671:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244847744:12345-192.168.204.43@tcp:1:lfs.0 Request processed in 28651us (29169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844679.862683:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:2.0:1788844679.880062:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844679.880318:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244848256 00000100:00100000:1.0:1788844679.880336:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244848256 00000100:00100000:1.0:1788844679.880416:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 56 00000100:00100000:1.0:1788844679.880430:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+43:11590:x1875739244848256:12345-192.168.204.43@tcp:35:lfs.0 00000004:00010000:1.0:1788844679.880565:0:5842:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da05e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc43 expref: 43 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788844679.881250:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788844679.881296:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1788844679.883238:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1788844679.883371:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.883397:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc20 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.883408:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.883461:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc20 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.883482:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc20 expref: 47 pid: 5838 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844679.883528:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc1908700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1875739267910144:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844679.883686:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed0389480 going to sleep for 11 seconds 00000100:00100000:2.0:1788844679.893287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844679.894209:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244848384 00000100:00100000:3.0:1788844679.894226:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244848384 00010000:00010000:3.0:1788844679.894290:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc20 expref: 48 pid: 5838 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844679.894348:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 77 00000100:00100000:3.0:1788844679.894360:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+48:2355:x1875739244848384:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844679.894380:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844679.894389:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc20 expref: 48 pid: 5838 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.894407:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc20 expref: 48 pid: 5838 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.894438:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:3.0:1788844679.894444:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.894982:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.894996:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844679.895045:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844679.895132:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+48:2355:x1875739244848384:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 771us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844679.895141:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 77 00010000:00010000:1.0:1788844679.895405:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc20 expref: 47 pid: 5838 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844679.895427:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc1908700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1875739267910144:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844679.895464:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.895475:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.895481:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788844679.895720:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1788844679.900484:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788844679.905212:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc1908700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267910272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788844679.905345:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844679.905403:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec51c50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844679.907330:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267910272 00000100:00100000:2.0:1788844679.907355:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267910272 00000100:00100000:2.0:1788844679.907456:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788844679.907468:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875739267910272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788844679.907981:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875739267910272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 512us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844679.907991:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788844679.910713:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc1908700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267910272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788844679.911403:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788844679.914689:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff2bc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267910400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788844679.914803:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844679.914854:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed0389480 going to sleep for 11 seconds 00000100:00100000:2.0:1788844679.915999:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267910400 00000100:00100000:2.0:1788844679.916015:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267910400 00000100:00100000:2.0:1788844679.916163:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788844679.916177:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875739267910400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788844679.916597:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1875739267910400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 420us (1791us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788844679.916606:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788844679.920405:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff2bc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875739267910400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788844679.920638:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788844679.920732:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.920773:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.920783:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.920791:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844679.920797:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.920806:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.920825:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:1.0:1788844679.920829:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788844679.920834:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844679.920841:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da073 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788844679.921134:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788844679.921306:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788844679.921322:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394199784387ns, next at 395199781066ns, rc = 0 00000001:00080000:1.0:1788844679.921330:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788844679.921375:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:1.0:1788844679.921379:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788844679.921398:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da05e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc43 expref: 51 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844679.921644:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+50:11590:x1875739244848256:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 41215us (41600us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788844679.921655:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 56 00000020:00080000:1.0:1788844679.921662:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788844679.925489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844679.931697:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244848512 00000100:00100000:0.0:1788844679.931722:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244848512 00000100:00100000:0.0:1788844679.931819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 203 00000100:00100000:0.0:1788844679.931852:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+50:11590:x1875739244848512:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1788844679.931887:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844679.931920:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da07a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc4a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.932011:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da07a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc4a expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.932030:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da07a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc4a expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844679.932060:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:0.0:1788844679.932064:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788844679.932069:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030000, rc 0) 00000100:00100000:0.0:1788844679.932184:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+51:11590:x1875739244848512:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 335us (6712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844679.932193:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 203 00000100:00100000:2.0:1788844679.936977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844679.937069:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244848768 00000100:00100000:0.0:1788844679.937093:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244848768 00000100:00100000:0.0:1788844679.937169:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:0.0:1788844679.937181:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+51:11590:x1875739244848768:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1788844679.937513:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:11590:x1875739244848768:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 333us (551us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788844679.937522:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 57 00000100:00100000:1.0:1788844680.028701:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844680.028849:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244848896 00000100:00100000:0.0:1788844680.028864:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244848896 00000100:00100000:0.0:1788844680.028965:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 204 00000100:00100000:0.0:1788844680.028998:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:11600:x1875739244848896:12345-192.168.204.43@tcp:34:lfs.0 00010000:00010000:0.0:1788844680.029130:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2da081 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029155:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2da081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029170:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2da081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029189:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029196:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029202:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029329:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029339:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029346:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788844680.029405:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029423:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2da081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029438:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2da081 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029447:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2da081 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029454:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844680.029459:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2da081 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029468:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2da081 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029484:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:0.0:1788844680.029488:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844680.029494:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2da081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029500:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030200/0x7f1093851e2da081 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029518:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029525:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da088 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029531:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029583:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844680.029593:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029600:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029609:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eee1796100) 00010000:00010000:0.0:1788844680.029612:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844680.029616:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da088 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029623:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029643:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029650:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029656:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029661:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844680.029665:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029671:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029678:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:0.0:1788844680.029681:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844680.029693:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.029700:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da08f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788844680.029843:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844680.031175:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:11600:x1875739244848896:12345-192.168.204.43@tcp:34:lfs.0 Request processed in 2168us (2476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844680.031191:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 204 00000100:00100000:2.0:1788844680.068019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844680.068169:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244849152 00000100:00100000:1.0:1788844680.068186:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244849152 00000100:00100000:1.0:1788844680.068266:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 205 00000100:00100000:1.0:1788844680.068279:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+52:11603:x1875739244849152:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844680.068310:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844680.068339:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da096 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc51 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.068443:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da09d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.068463:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da09d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.068476:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da09d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.068493:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.068500:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.068521:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.068951:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.068962:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.068969:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844680.068980:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788844680.069131:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da09d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069140:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da09d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069146:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da09d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069152:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844680.069157:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da09d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069165:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da09d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069181:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:1.0:1788844680.069185:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844680.069200:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da09d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069207:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da09d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069226:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069232:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069238:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069242:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844680.069245:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069251:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069258:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eec7351c00) 00010000:00010000:1.0:1788844680.069261:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844680.069264:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069270:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069323:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da096 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc51 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069350:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc51 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.069357:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844680.069360:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844680.069362:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60800, rc 0) 00000100:00100000:1.0:1788844680.069444:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:11603:x1875739244849152:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1166us (1444us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788844680.069454:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 205 00000100:00100000:2.0:1788844680.074284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.074405:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244849280 00000100:00100000:3.0:1788844680.074419:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244849280 00000100:00100000:3.0:1788844680.075061:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 206 00000100:00100000:3.0:1788844680.075095:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:11603:x1875739244849280:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:3.0:1788844680.075198:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.075221:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.075235:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.075271:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.075280:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.075288:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.075319:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844680.075325:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.075335:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.075351:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844680.075355:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844680.075362:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.075369:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844680.075491:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:11603:x1875739244849280:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 417us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844680.075500:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 206 00000100:00100000:2.0:1788844680.078024:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844680.078099:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244849536 00000100:00100000:1.0:1788844680.078114:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244849536 00000100:00100000:1.0:1788844680.078185:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:1.0:1788844680.078196:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+54:11603:x1875739244849536:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844680.078732:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:11603:x1875739244849536:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 536us (721us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788844680.079591:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 58 00000100:00100000:1.0:1788844680.138472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.138567:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244849792 00000100:00100000:3.0:1788844680.138645:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244849792 00000100:00100000:3.0:1788844680.138786:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 207 00000100:00100000:3.0:1788844680.138799:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:11613:x1875739244849792:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:3.0:1788844680.138830:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844680.138835:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788844680.138868:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da03b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc35 expref: 55 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.138890:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844680.138912:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844680.138929:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.139058:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.139074:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc51 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.139100:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.139139:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc51 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.139154:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc51 expref: 55 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844680.139169:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc2f87100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267910528:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844680.139287:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed86cb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844680.144894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.144948:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc2f87100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267910528:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844680.144986:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844680.145056:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244849920 00000100:00100000:0.0:1788844680.145067:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244849920 00010000:00010000:0.0:1788844680.145128:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc51 expref: 56 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844680.145163:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:0.0:1788844680.145171:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+56:2355:x1875739244849920:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844680.145190:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844680.145197:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc51 expref: 56 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.145211:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc51 expref: 56 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.145239:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60800/0x7f1093851e2da0ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc51 expref: 56 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.145258:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:0.0:1788844680.145262:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.145270:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.145296:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.145366:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844680.145426:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:2355:x1875739244849920:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 255us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844680.145433:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 78 00010000:00010000:1.0:1788844680.145516:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.145525:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844680.145577:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788844680.145794:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024200/0x7f1093851e2da0c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc58 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.145829:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc58 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.145838:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844680.145841:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788844680.145844:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:1.0:1788844680.145876:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:11613:x1875739244849792:12345-192.168.204.43@tcp:101:bash.0 Request processed in 7080us (7418us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788844680.145884:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 207 00000100:00100000:2.0:1788844680.148029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.148137:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244850176 00000100:00100000:3.0:1788844680.148151:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244850176 00000100:00100000:3.0:1788844680.148254:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 208 00000100:00100000:3.0:1788844680.148266:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+55:11613:x1875739244850176:12345-192.168.204.43@tcp:36:bash.0 00010000:00010000:2.0:1788844680.149019:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.149045:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.149060:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788844680.149141:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1788844680.149177:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc144f9d reply state 000000008f30a74b transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844680.149187:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844680.149312:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+58:11613:x1875739244850176:12345-192.168.204.43@tcp:36:bash.0 Request processed in 1046us (1290us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788844680.149320:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 208 00000020:00080000:2.0:1788844680.149327:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788844680.150905:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.150936:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.150945:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.150951:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844680.150958:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.150966:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.150988:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844680.150991:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844680.150997:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.151004:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da0d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844680.151701:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844680.151853:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244850304 00000100:00100000:0.0:1788844680.151866:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244850304 00000100:00100000:0.0:1788844680.151927:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 209 00000100:00100000:0.0:1788844680.151939:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+57:11613:x1875739244850304:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:0.0:1788844680.151969:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844680.151991:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da0dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc5f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.152116:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.152133:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc58 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.152144:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.152315:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc58 expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.152334:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc58 expref: 58 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844680.152370:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff1a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267910656:192.168.204.43@tcp:104: 00000100:00100000:0.0:1788844680.152512:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788844680.155870:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff1a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267910656:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844680.155913:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844680.156003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.156071:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244850432 00000100:00100000:3.0:1788844680.156099:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244850432 00010000:00010000:3.0:1788844680.156148:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc58 expref: 59 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844680.156197:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:3.0:1788844680.156208:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+59:2355:x1875739244850432:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844680.156240:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844680.156249:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc58 expref: 59 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.156262:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc58 expref: 59 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.156290:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da0c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc58 expref: 59 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.156309:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844680.156315:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.156461:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.156472:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.156512:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788844680.156578:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.156588:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844680.156652:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788844680.156658:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844680.156686:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.156724:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da0dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc5f expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.156744:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc5f expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.156752:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844680.156764:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844680.156768:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031e00, rc 0) 00000100:00100000:2.0:1788844680.157612:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+58:2355:x1875739244850432:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1397us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844680.157624:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:1.0:1788844680.159233:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+57:11613:x1875739244850304:12345-192.168.204.43@tcp:101:bash.0 Request processed in 7153us (7395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844680.159250:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 209 00000100:00100000:2.0:1788844680.163490:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844680.163686:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244850688 00000100:00100000:1.0:1788844680.163701:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244850688 00000100:00100000:1.0:1788844680.164260:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:1.0:1788844680.164276:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+57:11613:x1875739244850688:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:1.0:1788844680.164650:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+58:11613:x1875739244850688:12345-192.168.204.43@tcp:35:bash.0 Request processed in 377us (1175us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788844680.164658:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 59 00000100:00100000:0.0:1788844680.254382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844680.254748:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244850816 00000100:00100000:2.0:1788844680.254762:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244850816 00000100:00100000:2.0:1788844680.254997:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 210 00000100:00100000:2.0:1788844680.255011:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+58:11619:x1875739244850816:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844680.255048:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844680.255091:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2da0ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc66 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.255195:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da0f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.255215:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.255243:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844680.255297:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788844680.255302:0:8217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844680.255325:0:8217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.255356:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64a00/0x7f1093851e2da0ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc66 expref: 60 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.255380:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc66 expref: 59 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.255390:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:2.0:1788844680.255394:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844680.255399:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64e00, rc 0) 00000100:00100000:2.0:1788844680.256718:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+59:11619:x1875739244850816:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1697us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844680.256751:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 210 00000100:00100000:2.0:1788844680.275479:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844680.282304:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244850944 00000100:00100000:1.0:1788844680.282328:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244850944 00000100:00100000:1.0:1788844680.282430:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 211 00000100:00100000:1.0:1788844680.282443:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+59:11619:x1875739244850944:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844680.282469:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844680.282500:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da0f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc6d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282623:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282642:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282656:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282696:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282704:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282712:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282837:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282847:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282854:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844680.282902:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788844680.282908:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844680.282934:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282949:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282959:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282965:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282984:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.282992:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844680.282997:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283006:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283021:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:1.0:1788844680.283025:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844680.283029:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283036:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da0ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283055:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283061:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283067:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283072:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844680.283093:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283110:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283119:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eec7351c00) 00010000:00010000:1.0:1788844680.283122:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844680.283125:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283131:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283171:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da0f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc6d expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283190:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc6d expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.283197:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844680.283200:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844680.283202:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60600, rc 0) 00000100:00100000:1.0:1788844680.283295:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:11619:x1875739244850944:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 854us (7831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844680.283303:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 211 00000100:00100000:3.0:1788844680.287516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844680.298610:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244851200 00000100:00100000:0.0:1788844680.298633:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244851200 00000100:00100000:0.0:1788844680.298724:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 212 00000100:00100000:0.0:1788844680.298747:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:11619:x1875739244851200:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1788844680.298776:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844680.298809:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da114 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc74 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.298959:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.298978:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc5f expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.298987:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc6d expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.298994:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.299064:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc6d expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.299089:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc6d expref: 61 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844680.299453:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefff3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267910784:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844680.299632:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc5f expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.299643:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc5f expref: 61 pid: 5838 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844680.299654:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefff3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267910912:192.168.204.43@tcp:104: 00000100:00100000:0.0:1788844680.299687:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1780 going to sleep for 11 seconds 00000100:00100000:2.0:1788844680.301967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.302294:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244851328 00000100:00100000:3.0:1788844680.302306:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244851328 00010000:00010000:3.0:1788844680.302366:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc6d expref: 62 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844680.302423:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:3.0:1788844680.302434:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+62:2355:x1875739244851328:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844680.302472:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844680.302481:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc6d expref: 62 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.302496:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc6d expref: 62 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.302525:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844680.302532:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.302802:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.302811:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844680.303025:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+62:2355:x1875739244851328:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 591us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844680.303034:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 80 00010000:00010000:0.0:1788844680.303277:0:5839:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.43@tcp) returned -22 from blocking AST (req@000000006c4048c1 x1875739267910784) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc6d expref: 61 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.303293:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da10d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc6d expref: 61 pid: 5840 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844680.303312:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefff3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267910784:192.168.204.43@tcp:104: 00000100:00100000:0.0:1788844680.303340:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefff3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875739267910912:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844680.303365:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:0.0:1788844680.303379:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.303386:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.303394:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844680.306790:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844680.307047:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244851456 00000100:00100000:1.0:1788844680.307061:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244851456 00010000:00010000:1.0:1788844680.307131:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc5f expref: 61 pid: 5838 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844680.307206:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00100000:1.0:1788844680.307218:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:2354:x1875739244851456:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844680.307240:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844680.307249:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc5f expref: 61 pid: 5838 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.307264:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc5f expref: 61 pid: 5838 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.307296:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da0e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc5f expref: 61 pid: 5838 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.307318:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844680.307324:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.307335:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.307344:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.307384:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788844680.307674:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.307685:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844680.307712:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788844680.307921:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da114 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc74 expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.307940:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc74 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.307948:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:2.0:1788844680.307951:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788844680.307954:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031600, rc 0) 00000100:00100000:2.0:1788844680.307986:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:11619:x1875739244851200:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 9243us (21267us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788844680.307995:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 212 00000100:00100000:1.0:1788844680.308186:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:2354:x1875739244851456:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 969us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844680.308194:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00100000:2.0:1788844680.318176:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.318253:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244851712 00000100:00100000:3.0:1788844680.318268:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244851712 00000100:00100000:3.0:1788844680.318464:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1788844680.318477:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:11619:x1875739244851712:12345-192.168.204.43@tcp:103:lfs.0 00010000:00010000:3.0:1788844680.318500:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844680.318586:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da07a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc4a expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.318613:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844680.318643:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844680.318723:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+59:11619:x1875739244851712:12345-192.168.204.43@tcp:103:lfs.0 Request processed in 248us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844680.318800:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1788844680.321164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844680.329812:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244851840 00000100:00100000:1.0:1788844680.329863:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244851840 00000100:00100000:1.0:1788844680.329969:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 213 00000100:00100000:1.0:1788844680.329982:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+59:11619:x1875739244851840:12345-192.168.204.43@tcp:58:lfs.0 00010000:00010000:1.0:1788844680.330166:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.330191:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.330207:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788844680.330507:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788844680.331795:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+59:11619:x1875739244851840:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 1803us (10632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844680.331811:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 213 00000100:00100000:2.0:1788844680.341824:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.343801:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244851968 00000100:00100000:3.0:1788844680.343823:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244851968 00000100:00100000:2.0:1788844680.346777:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 214 00000100:00100000:2.0:1788844680.346796:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+59:11619:x1875739244851968:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844680.346851:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844680.346881:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2da130 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc7b expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.346967:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.346981:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2da130 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc7b expref: 60 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.347008:0:8217:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.347023:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2da130 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc7b expref: 60 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.347041:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:2.0:1788844680.347045:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788844680.347049:0:8217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2da130 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc7b expref: 60 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.347058:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65400, rc 0) 00000100:00100000:2.0:1788844680.347211:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:11619:x1875739244851968:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 418us (5404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844680.347219:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 214 00010000:00010000:1.0:1788844680.378717:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788844680.827048:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788844680.827076:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788844680.827129:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788844680.827139:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788844680.827821:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefff3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267911040:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788844680.828022:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788844680.836785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844680.836950:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefff3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267911040:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788844680.837255:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244852096 00000100:00100000:1.0:1788844680.837274:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244852096 00000100:00100000:1.0:1788844680.837354:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 215 00000100:00100000:1.0:1788844680.837365:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:11620:x1875739244852096:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788844680.837407:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788844680.837569:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:11620:x1875739244852096:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 205us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844680.837578:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 215 00000100:00100000:2.0:1788844680.841328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844680.841494:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244852224 00000100:00100000:0.0:1788844680.841520:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244852224 00000100:00100000:0.0:1788844680.841645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 216 00000100:00100000:0.0:1788844680.841660:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:11620:x1875739244852224:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788844680.841770:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da137 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.841793:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da137 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.841810:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da137 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.841829:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da13e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.841856:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da13e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.841863:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da13e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.841896:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.841904:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.841910:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844680.841961:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788844680.841967:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788844680.841986:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842000:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da137 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842008:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da137 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842015:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da137 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842022:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844680.842027:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da137 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842043:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da137 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842060:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:0.0:1788844680.842072:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844680.842078:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da137 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842085:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030000/0x7f1093851e2da137 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842102:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da13e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842108:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da13e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842113:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da13e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842119:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844680.842122:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da13e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842128:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da13e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842134:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff91eee1796100) 00010000:00010000:0.0:1788844680.842137:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844680.842139:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da13e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842158:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da13e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842176:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842183:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842189:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842194:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844680.842197:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842203:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842211:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:0.0:1788844680.842213:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844680.842216:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.842222:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844680.842453:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:11620:x1875739244852224:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 Request processed in 796us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844680.842463:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 216 00000100:00100000:0.0:1788844680.846976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844680.849221:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244852480 00000100:00100000:1.0:1788844680.849246:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244852480 00000100:00100000:1.0:1788844680.849460:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 217 00000100:00100000:1.0:1788844680.849474:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+60:11620:x1875739244852480:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788844680.849524:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844680.849578:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da14c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.849739:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.849760:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.849774:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844680.849788:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788844680.849928:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.849936:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da153 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.849944:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.849950:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844680.849956:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.849966:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.850205:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844680.850216:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788844680.850223:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da153 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.850231:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.850296:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da14c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc82 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.850310:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:1.0:1788844680.850312:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788844680.850317:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da14c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc82 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.850327:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61000, rc 0) 00000100:00100000:1.0:1788844680.850478:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:11620:x1875739244852480:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1006us (3635us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1788844680.850487:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 217 00000100:00100000:2.0:1788844680.854907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844680.855075:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244852608 00000100:00100000:0.0:1788844680.855090:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244852608 00000100:00100000:0.0:1788844680.855169:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 218 00000100:00100000:0.0:1788844680.855182:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:11620:x1875739244852608:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788844680.855235:0:8217:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788844680.855393:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:11620:x1875739244852608:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 212us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844680.855402:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 218 00000100:00100000:2.0:1788844680.860771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.861070:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244852864 00000100:00100000:3.0:1788844680.861087:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244852864 00000100:00100000:3.0:1788844680.861176:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 219 00000100:00100000:3.0:1788844680.861188:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:11620:x1875739244852864:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844680.861220:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844680.861225:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788844680.861268:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da0f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc66 expref: 61 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.861297:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844680.861303:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844680.861326:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da161 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc89 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788844680.862355:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788844680.862724:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.862744:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.862758:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.862863:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da161 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc89 expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.862887:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc89 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.862897:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eed03a8800) 00010000:00010000:3.0:1788844680.862900:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844680.862904:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:3.0:1788844680.863010:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+62:11620:x1875739244852864:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1823us (2255us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788844680.863021:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 219 00000100:00100000:1.0:1788844680.866803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844680.866953:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244853120 00000100:00100000:0.0:1788844680.866968:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244853120 00000100:00100000:0.0:1788844680.867052:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 220 00000100:00100000:0.0:1788844680.867075:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+62:11620:x1875739244853120:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788844680.867160:0:8217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844680.867196:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc89 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867218:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eed03a8800) 00010000:00010000:0.0:1788844680.867231:0:8217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788844680.867259:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da176 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867275:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da176 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867287:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da176 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867304:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da17d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfbe96e75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867334:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da17d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfbe96e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867341:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da17d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfbe96e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867431:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da176 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867440:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da176 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867449:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da176 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867457:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844680.867462:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da176 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867472:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da176 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867482:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:0.0:1788844680.867485:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844680.867490:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da176 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867498:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031e00/0x7f1093851e2da176 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867508:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da17d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfbe96e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867520:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da17d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfbe96e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867527:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da17d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfbe96e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.867532:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844680.868129:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da17d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfbe96e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.868144:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da17d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfbe96e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.868155:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfbe96e75 (ffff91eee1796100) 00010000:00010000:0.0:1788844680.868159:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844680.868162:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da17d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfbe96e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.868170:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da17d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfbe96e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844680.868339:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:11620:x1875739244853120:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 1271us (1548us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788844680.868349:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 220 00000100:00100000:2.0:1788844680.879154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844680.882420:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244853248 00000100:00100000:1.0:1788844680.882502:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244853248 00000100:00100000:1.0:1788844680.882670:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 221 00000100:00100000:1.0:1788844680.882683:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+61:11620:x1875739244853248:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788844680.882710:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844680.882743:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.882793:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.882830:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.882843:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.883509:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61000/0x7f1093851e2da184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc90 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.884099:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc90 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.884114:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:1.0:1788844680.884117:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788844680.884121:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61600, rc 0) 00000100:00100000:1.0:1788844680.884235:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+62:11620:x1875739244853248:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1553us (5096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844680.884245:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 221 00000100:00100000:2.0:1788844680.893376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844680.893679:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244853504 00000100:00100000:0.0:1788844680.893694:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244853504 00000100:00100000:0.0:1788844680.893790:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 222 00000100:00100000:0.0:1788844680.893804:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+62:11620:x1875739244853504:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788844680.893950:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.893992:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844680.894006:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788844680.894419:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788844680.894433:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395172896015ns, next at 396172892474ns, rc = 0 00000004:00010000:0.0:1788844680.894593:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c6291f8 reply state 00000000d140f297 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844680.894606:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788844680.894763:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+64:11620:x1875739244853504:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 959us (1401us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788844680.894773:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 222 00010000:00010000:3.0:1788844680.898434:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.898461:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.898470:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.898478:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844680.898485:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.898494:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.898517:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:3.0:1788844680.898559:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788844680.898566:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.898573:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da192 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844680.898797:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.899190:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244853632 00000100:00100000:3.0:1788844680.899204:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244853632 00000100:00100000:3.0:1788844680.899276:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 223 00000100:00100000:3.0:1788844680.899288:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+63:11620:x1875739244853632:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788844680.899318:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844680.899341:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da199 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc97 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.899417:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da199 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc97 expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.899431:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da199 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc97 expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844680.899451:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:3.0:1788844680.899455:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788844680.899457:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025800, rc 0) 00000100:00100000:3.0:1788844680.899574:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+64:11620:x1875739244853632:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 286us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844680.899582:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 223 00000100:00100000:0.0:1788844680.908420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.911822:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244853760 00000100:00100000:3.0:1788844680.911960:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244853760 00000100:00100000:2.0:1788844680.916334:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:2.0:1788844680.916355:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2355:x1875739244853760:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788844680.916939:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:2355:x1875739244853760:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 586us (8531us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788844680.916949:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00080000:3.0:1788844680.917311:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844680.923184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844680.923384:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244854016 00000100:00100000:0.0:1788844680.923398:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244854016 00000100:00100000:0.0:1788844680.923485:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:0.0:1788844680.923497:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+64:11620:x1875739244854016:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788844680.923972:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+65:11620:x1875739244854016:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 475us (805us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788844680.923983:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 60 00000100:00100000:0.0:1788844680.936974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844680.937250:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244854272 00000100:00100000:2.0:1788844680.937264:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244854272 00000100:00100000:2.0:1788844680.937345:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 224 00000100:00100000:2.0:1788844680.937358:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+65:11620:x1875739244854272:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788844680.937785:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+65:11620:x1875739244854272:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 180us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844680.937795:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 224 00000100:00100000:2.0:1788844680.947652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844680.956506:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244854400 00000100:00100000:3.0:1788844680.956529:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244854400 00000100:00100000:2.0:1788844680.958104:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 225 00000100:00100000:2.0:1788844680.958123:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+65:11620:x1875739244854400:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788844680.958155:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844680.958184:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2da1a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fc9e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.958284:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da1a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.958320:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.958335:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844680.958390:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844680.958412:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.958455:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64600/0x7f1093851e2da1a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc9e expref: 67 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.958479:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc9e expref: 66 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.958489:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:2.0:1788844680.958493:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788844680.958497:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65000, rc 0) 00000100:00100000:2.0:1788844680.958613:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+66:11620:x1875739244854400:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 495us (10978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844680.958622:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 225 00000100:00100000:2.0:1788844680.974089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844680.983142:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244854528 00000100:00100000:0.0:1788844680.983168:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244854528 00000100:00100000:1.0:1788844680.983392:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 65 00000100:00100000:1.0:1788844680.983405:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+10:2354:x1875739244854528:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788844680.983430:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844680.983461:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fbab0e3/0x7f1093851e2da1ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fca5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788844680.983498:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9a88, blocks: 0x1 00010000:00010000:1.0:1788844680.983527:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1788844680.983591:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844680.983604:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fbab0e3/0x7f1093851e2da1ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fca5 expref: 11 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.983630:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fbab0e3/0x7f1093851e2da1ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fca5 expref: 11 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844680.983648:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61000, rc 0) 00000100:00100000:1.0:1788844680.983744:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec5993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+11:2354:x1875739244854528:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 339us (9681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844680.983752:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 65 00000100:00100000:0.0:1788844680.989653:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844680.989827:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244854784 00000100:00100000:2.0:1788844680.989840:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244854784 00000100:00100000:2.0:1788844680.989924:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 226 00000100:00100000:2.0:1788844680.989936:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+66:11620:x1875739244854784:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788844680.990102:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+66:11620:x1875739244854784:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 167us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844680.990119:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 226 00000100:00100000:0.0:1788844680.994606:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844680.994988:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244854912 00000100:00100000:2.0:1788844680.995003:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244854912 00000100:00100000:2.0:1788844680.995082:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:2.0:1788844680.995095:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+11:11620:x1875739244854912:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788844680.995119:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844680.995144:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fcac expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.995192:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fbab0e3/0x7f1093851e2da1ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fca5 expref: 12 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.995202:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844680.995207:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844680.995212:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.995254:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fbab0e3/0x7f1093851e2da1ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fca5 expref: 12 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844680.995270:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fbab0e3/0x7f1093851e2da1ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fca5 expref: 12 pid: 6686 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844680.995286:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875739267911168:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844680.995432:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed54f2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788844681.001072:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875739267911168:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844681.001127:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.001156:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64600, rc 0) 00000100:00100000:2.0:1788844681.001240:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:11620:x1875739244854912:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 6147us (6650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844681.001250:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:0.0:1788844681.005628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844681.009656:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244855040 00000100:00100000:1.0:1788844681.009678:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244855040 00010000:00010000:1.0:1788844681.009997:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fbab0e3/0x7f1093851e2da1ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fca5 expref: 12 pid: 6686 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844681.010143:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:1.0:1788844681.010157:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:2355:x1875739244855040:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844681.010180:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844681.010211:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fbab0e3/0x7f1093851e2da1ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fca5 expref: 12 pid: 6686 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.010228:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fbab0e3/0x7f1093851e2da1ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fca5 expref: 12 pid: 6686 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.010258:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fbab0e3/0x7f1093851e2da1ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fca5 expref: 12 pid: 6686 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.010321:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844681.010327:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844681.010338:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.010349:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.010403:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844681.010419:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb3de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1875739267911296:192.168.204.43@tcp:105: 00000100:00100000:1.0:1788844681.010604:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff91edc12f8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844681.021054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844681.021675:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244855168 00000100:00100000:2.0:1788844681.021689:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244855168 00002000:00100000:2.0:1788844681.021781:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff91eeff8b3100 x1875739244855168/t0(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:542/0 lens 504/0 e 0 to 0 dl 1788844692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788844681.021795:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eeff8b3100 with x1875739244855168 ext(0->12) 00002000:00010000:2.0:1788844681.021803:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eeff8b3100 00000100:00100000:2.0:1788844681.021844:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:2.0:1788844681.021855:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:2355:x1875739244855168:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788844681.022960:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+14:2355:x1875739244855168:12345-192.168.204.43@tcp:4:lhsmtool_posix.0 Request processed in 1097us (1915us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788844681.022973:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00002000:00100000:2.0:1788844681.022984:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff91eeff8b3100 x1875739244855168/t4294967320(0) o4->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:542/0 lens 504/448 e 0 to 0 dl 1788844692 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788844681.022995:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eeff8b3100 with x1875739244855168 ext(0->12) 00002000:00010000:2.0:1788844681.022999:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eeff8b3100 00000100:00100000:1.0:1788844681.025088:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb3de680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1875739267911296:192.168.204.43@tcp:105: 00010000:00010000:1.0:1788844681.025134:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844681.025268:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2355:x1875739244855040:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 15112us (19658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844681.025280:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:0.0:1788844681.031755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844681.031854:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244855296 00000100:00100000:2.0:1788844681.031888:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244855296 00000100:00100000:2.0:1788844681.031971:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 227 00000100:00100000:2.0:1788844681.031984:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+66:11620:x1875739244855296:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788844681.142155:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1788844681.142181:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000004:00080000:2.0:1788844681.142209:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:2.0:1788844681.142226:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eec336ca80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788844681.142232:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eec562f700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eec336cb40 00000020:00080000:2.0:1788844681.142236:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eec562fb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eef3e08000 00000004:00080000:2.0:1788844681.142284:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788844681.142309:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eed0389c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788844681.142313:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eed06a0d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eec2f586c0 00000020:00080000:2.0:1788844681.142316:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eed06a0f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eed22d5400 00000100:00100000:0.0:1788844681.142683:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267911552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788844681.142790:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844681.142870:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788844681.142877:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267911424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788844681.142904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844681.142939:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267911552 00000100:00100000:0.0:1788844681.142948:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267911552 00000100:00100000:0.0:1788844681.143015:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267911424 00000100:00100000:0.0:1788844681.143019:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267911424 00000100:00100000:0.0:1788844681.143046:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788844681.143066:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875739267911552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788844681.143282:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788844681.143286:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788844680 00002000:00010000:0.0:1788844681.143290:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788844681.143292:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788844680 -> 1788844680 00002000:00010000:0.0:1788844681.143295:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788844681.147032:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3308:x1875739267911552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3968us (4233us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788844681.147048:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788844681.147110:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788844681.147125:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875739267911424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788844681.147168:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788844681.147204:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.147256:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9f7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc0b expref: 12 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.147267:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788844681.147272:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788844681.147278:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.147341:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc0b expref: 12 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.147361:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc0b expref: 12 pid: 7066 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844681.147380:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875739267911680:192.168.204.43@tcp:104: 00000100:00100000:0.0:1788844681.147480:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed559d000 going to sleep for 11 seconds 00000100:00080000:0.0:1788844681.147513:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788844681.147614:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eed8284700/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788844681.147623:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267911552:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1788844681.147840:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788844681.148146:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788844681.148276:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc2f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267911808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788844681.148331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844681.149089:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267911808 00000100:00100000:0.0:1788844681.149100:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267911808 00000100:00100000:0.0:1788844681.149165:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788844681.149175:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875739267911808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788844681.149206:0:7066:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788844681.149261:0:7066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9a86, atime: 0x6a9f9a87, ctime: 0x6a9f9a86, blocks: 0x1 00010000:00010000:0.0:1788844681.149270:0:7066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dec7081/0x7f1093851e2da1c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.149287:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:0.0:1788844681.149291:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844681.149519:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dec7081/0x7f1093851e2da1c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788844681.149682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788844681.149844:0:7066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dec7081/0x7f1093851e2da1c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.149858:0:7066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dec7081/0x7f1093851e2da1c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.149867:0:7066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dec7081/0x7f1093851e2da1c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.149931:0:7066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788844681.152421:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11620:x1875739244855296:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 Request processed in 120422us (120663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844681.152439:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 227 00000100:00100000:0.0:1788844681.153775:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875739267911808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4595us (5437us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788844681.153790:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:1.0:1788844681.154479:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91edc2f87480/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788844681.154490:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc2f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267911808:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788844681.155901:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844681.155920:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dec7081/0x7f1093851e2da1c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.155938:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031e00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844681.155944:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dec7081/0x7f1093851e2da1c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.155957:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dec7081/0x7f1093851e2da1c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.155984:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dec7081/0x7f1093851e2da1c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.155992:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dec7081/0x7f1093851e2da1c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844681.156527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844681.156660:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844681.156785:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244855424 00000100:00100000:1.0:1788844681.156798:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244855424 00010000:00010000:1.0:1788844681.156851:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9f7e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc0b expref: 13 pid: 7066 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844681.156893:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00100000:1.0:1788844681.156905:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2357:x1875739244855424:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844681.156926:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844681.156933:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9f7e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc0b expref: 13 pid: 7066 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.156949:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc0b expref: 13 pid: 7066 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.156974:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788844681.156980:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788844681.156988:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.157001:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.157027:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788844681.157117:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+13:2357:x1875739244855424:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 213us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844681.157126:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 83 00010000:00010000:3.0:1788844681.157575:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c419a93a/0x7f1093851e2d9f7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc0b expref: 12 pid: 7066 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844681.157608:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875739267911680:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844681.157636:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.157650:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.157657:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.157669:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.157676:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.157699:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788844681.158421:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3308:x1875739267911424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11298us (15511us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788844681.158435:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1788844681.158924:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844681.158936:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.158967:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844681.158973:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.158986:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.159010:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.159019:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b3aa2d2/0x7f1093851e2da1bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.159047:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844681.159049:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844681.159050:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788844681.159110:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eed8286d80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788844681.159120:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267911424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788844681.160629:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244855552 00000100:00100000:3.0:1788844681.160646:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244855552 00000100:00100000:2.0:1788844681.161839:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 70 00000100:00100000:2.0:1788844681.161866:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:2356:x1875739244855552:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788844681.163493:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844681.271755:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+12:2356:x1875739244855552:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 Request processed in 109884us (115076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844681.271775:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 70 00000001:00080000:3.0:1788844681.276459:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1788844681.276491:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:3.0:1788844681.276534:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:3.0:1788844681.276626:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:0.0:1788844681.281935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844681.282048:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244855808 00000100:00100000:2.0:1788844681.282073:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244855808 00000100:00100000:2.0:1788844681.282152:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 228 00000100:00100000:2.0:1788844681.282166:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11620:x1875739244855808:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788844681.282243:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844681.282282:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65000/0x7f1093851e2da1a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc9e expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.282362:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:2.0:1788844681.282387:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788844681.282432:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.282450:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.282462:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788844681.283199:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099cc46bd reply state 00000000481b6ebf transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844681.283214:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844681.284700:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed84d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:11620:x1875739244855808:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 2521us (2764us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788844681.284846:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 228 00000100:00100000:1.0:1788844681.294245:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844681.294581:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244855936 00000100:00100000:0.0:1788844681.294600:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244855936 00000100:00100000:0.0:1788844681.294682:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 71 00000100:00100000:0.0:1788844681.294860:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244855936:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788844681.295229:0:7066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788844681.295235:0:7066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788844680 -> 1788844679 00002000:00010000:0.0:1788844681.295238:0:7066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788844679 00002000:00010000:0.0:1788844681.295241:0:7066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788844680 -> 1788844679 00002000:00010000:0.0:1788844681.295244:0:7066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788844681.295392:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244855936:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 678us (1161us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788844681.295401:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 71 00010000:00010000:2.0:1788844681.297200:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.297221:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.297229:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.297235:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844681.297241:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.297251:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.297308:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:2.0:1788844681.297312:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844681.297319:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.297326:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64000/0x7f1093851e2da1ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844681.299683:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844681.299951:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244856192 00000100:00100000:1.0:1788844681.299964:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244856192 00000100:00100000:1.0:1788844681.300040:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 229 00000100:00100000:1.0:1788844681.300062:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11620:x1875739244856192:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788844681.300158:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.300178:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc90 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.300187:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.300235:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc90 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.300253:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc90 expref: 20 pid: 5838 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844681.300272:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb394e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267911936:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844681.300962:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff91edc12f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788844681.305090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844681.305233:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb394e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875739267911936:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844681.305274:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844681.305902:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244856320 00000100:00100000:2.0:1788844681.305913:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244856320 00010000:00010000:0.0:1788844681.306062:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc90 expref: 21 pid: 5838 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844681.306154:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:0.0:1788844681.306166:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:2355:x1875739244856320:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844681.306188:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844681.306197:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc90 expref: 21 pid: 5838 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.306211:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc90 expref: 21 pid: 5838 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.306270:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da18b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc90 expref: 21 pid: 5838 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.306291:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:0.0:1788844681.306308:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.306321:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.306330:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.306403:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844681.306492:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:2355:x1875739244856320:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 327us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844681.306502:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 84 00010000:00010000:2.0:1788844681.308153:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.308174:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.308217:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.308225:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.308234:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.308241:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61400 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844681.308246:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.308256:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.308307:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:2.0:1788844681.308311:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788844681.308316:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.308323:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da1d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844681.308628:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:11620:x1875739244856192:12345-192.168.204.43@tcp:55:lhsmtool_posix.0 Request processed in 8570us (8952us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788844681.308640:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 229 00000100:00100000:1.0:1788844681.311913:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844681.312179:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244856448 00000100:00100000:2.0:1788844681.312192:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244856448 00000100:00100000:2.0:1788844681.312356:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 72 00000100:00100000:2.0:1788844681.312369:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244856448:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788844681.312506:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.312674:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.312687:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844681.312692:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788844681.312699:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.312870:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.312912:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 8 pid: 6688 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844681.312931:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875739267912064:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844681.313088:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec7050f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788844681.317376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844681.317453:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244856576 00000100:00100000:3.0:1788844681.317465:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244856576 00010000:00010000:3.0:1788844681.317517:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 9 pid: 6688 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844681.317598:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:3.0:1788844681.317611:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+9:2354:x1875739244856576:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844681.317634:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844681.317668:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 9 pid: 6688 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.317686:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 9 pid: 6688 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.317737:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844681.317743:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844681.317752:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.317766:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.317800:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788844681.317938:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da1b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcac expref: 9 pid: 6688 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844681.317958:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875739267912064:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844681.317987:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.318000:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.318033:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.318081:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.318092:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.318100:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.318107:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844681.318112:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.318121:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.318134:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.318141:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da1d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844681.319194:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244856576:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 1577us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844681.319222:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:0.0:1788844681.319326:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244856448:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 Request processed in 6959us (7430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844681.319336:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 72 00000100:00100000:2.0:1788844681.322328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844681.322503:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244856832 00000100:00100000:3.0:1788844681.322517:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244856832 00000100:00100000:3.0:1788844681.322737:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 230 00000100:00100000:3.0:1788844681.322750:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:11620:x1875739244856832:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788844681.322867:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da1df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.322890:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da1df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.322905:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da1df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.323202:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.323216:0:8217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da199 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc97 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.323226:0:8217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.323269:0:8217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da199 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc97 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.323285:0:8217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da199 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc97 expref: 20 pid: 5840 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844681.323334:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc2f84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267912192:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844681.323462:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed1dbb480 going to sleep for 11 seconds 00000100:00100000:1.0:1788844681.327010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844681.327430:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244856960 00000100:00100000:0.0:1788844681.327446:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244856960 00010000:00010000:0.0:1788844681.327500:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da199 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc97 expref: 21 pid: 5840 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844681.327603:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:0.0:1788844681.327615:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:2355:x1875739244856960:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844681.327635:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844681.327645:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da199 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc97 expref: 21 pid: 5840 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.327662:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da199 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc97 expref: 21 pid: 5840 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.327694:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:0.0:1788844681.327700:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.327712:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.327720:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.327768:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844681.327852:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8298700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:2355:x1875739244856960:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 239us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844681.327862:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 86 00010000:00010000:3.0:1788844681.329020:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025800/0x7f1093851e2da199 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc97 expref: 20 pid: 5840 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844681.329047:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc2f84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267912192:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844681.329085:0:8217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.329097:0:8217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.329103:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788844681.329351:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788844681.329744:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788844681.329943:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788844681.330072:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc2f84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1875739267912320:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788844681.330165:0:8217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844681.330208:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec58acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788844681.330299:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267912320 00000100:00100000:0.0:1788844681.330308:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267912320 00000100:00100000:0.0:1788844681.330359:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788844681.330370:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8217:x1875739267912320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788844681.330470:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8217:x1875739267912320:12345-0@lo:1000:mdt00_003.0 Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844681.330480:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788844681.330908:0:8217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788844681.330917:0:8217:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1788844681.330939:0:8217:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eed8284700, transno 4294967321 00000004:00080000:3.0:1788844681.330954:0:8217:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eed8286d80, transno 4294967322 00000100:00100000:3.0:1788844681.330961:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc2f84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1875739267912320:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788844681.332506:0:8217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788844681.333171:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc2f84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1875739267912448:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788844681.333263:0:8217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844681.333304:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844681.333378:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267912448 00000100:00100000:0.0:1788844681.333388:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267912448 00000100:00100000:0.0:1788844681.333459:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788844681.333470:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8217:x1875739267912448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788844681.334115:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8217:x1875739267912448:12345-0@lo:1000:mdt00_003.0 Request processed in 642us (848us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788844681.334126:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788844681.334256:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc2f84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8217:1875739267912448:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788844681.334304:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334316:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334326:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334333:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844681.334339:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334348:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334369:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eec7351c00) 00010000:00010000:3.0:1788844681.334373:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788844681.334379:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334386:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024e00/0x7f1093851e2da1e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334492:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334516:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334523:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334529:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60000 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844681.334533:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334623:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334635:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844681.334637:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788844681.334647:0:8217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2da130 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc7b expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334661:0:8217:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2da130 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc7b expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334673:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2da130 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc7b expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.334778:0:8217:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2da130 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc7b expref: 23 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844681.334860:0:8217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc2f86300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267912576:192.168.204.43@tcp:105: 00000100:00100000:3.0:1788844681.335018:0:8217:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788844681.338674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844681.338792:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244857088 00000100:00100000:2.0:1788844681.338806:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244857088 00000100:00100000:2.0:1788844681.338877:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:2.0:1788844681.338888:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:11619:x1875739244857088:12345-192.168.204.43@tcp:49:lfs.0 00000100:00100000:2.0:1788844681.339078:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+24:11619:x1875739244857088:12345-192.168.204.43@tcp:49:lfs.0 Request processed in 191us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844681.339087:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 61 00000100:00100000:3.0:1788844681.339404:0:8217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc2f86300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8217:1875739267912576:192.168.204.43@tcp:105: 00010000:00010000:3.0:1788844681.339525:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339564:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da129 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339608:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da1ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339625:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da1ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339639:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da1ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339651:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da1ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339658:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da1ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339666:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da1ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339673:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844681.339677:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da1ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339685:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da1ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339857:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844681.339861:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844681.339865:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da1ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339872:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da1ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339886:0:8217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da1df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339893:0:8217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da1df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339899:0:8217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da1df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339905:0:8217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844681.339908:0:8217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da1df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339915:0:8217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da1df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339923:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844681.339926:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788844681.339929:0:8217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da1df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.339935:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da1df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844681.340253:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:11620:x1875739244856832:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 17503us (17938us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1788844681.340264:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 230 00000020:00080000:3.0:1788844681.340269:0:8217:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788844681.343977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844681.344105:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844681.344233:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244857600 00000100:00100000:0.0:1788844681.344248:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244857600 00000100:00100000:0.0:1788844681.344317:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 62 00000100:00100000:0.0:1788844681.344329:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:11620:x1875739244857600:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788844681.344828:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244857344 00000100:00100000:2.0:1788844681.344835:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244857344 00000100:00100000:2.0:1788844681.344874:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 231 00000100:00100000:2.0:1788844681.344882:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:11619:x1875739244857344:12345-192.168.204.43@tcp:58:lfs.0 00000040:00080000:2.0:1788844681.345296:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788844681.345410:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:11619:x1875739244857344:12345-192.168.204.43@tcp:58:lfs.0 Request processed in 527us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844681.345420:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 231 00000004:00080000:0.0:1788844681.346333:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788844681.346456:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1788844681.346528:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.346594:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.346609:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.346621:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.346629:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.346636:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844681.346658:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844681.347359:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844681.347369:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.347387:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030c00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844681.347392:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.347401:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.347428:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91eee1796d00) 00010000:00010000:2.0:1788844681.347432:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788844681.347438:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.347444:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da1f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.347472:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844681.347474:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844681.347476:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844681.349601:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:11620:x1875739244857600:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 5256us (5480us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788844681.349621:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 62 00000020:00080000:0.0:1788844681.349631:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1788844681.350960:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788844681.350971:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788844681.351063:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788844681.351073:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788844681.351229:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff834380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267912704:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788844681.351318:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff91edc12f8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844681.356004:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff834380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11673:1875739267912704:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788844681.377875:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844681.378043:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244857728 00000100:00100000:0.0:1788844681.378067:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244857728 00000100:00100000:0.0:1788844681.378143:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 232 00000100:00100000:0.0:1788844681.378155:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:11621:x1875739244857728:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788844681.378202:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788844681.378344:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:11621:x1875739244857728:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 190us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844681.378353:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 232 00000100:00100000:3.0:1788844681.389072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844681.389473:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244857856 00000100:00100000:2.0:1788844681.389487:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244857856 00000100:00100000:2.0:1788844681.389624:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 233 00000100:00100000:2.0:1788844681.389638:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+25:11623:x1875739244857856:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844681.389666:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844681.389695:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2da1fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fcb3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.389803:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2da202 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.389845:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2da202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.389858:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2da202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.389876:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.389883:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.389890:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.390201:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.390214:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc74 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.390225:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.390267:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc74 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.390286:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc74 expref: 26 pid: 5839 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844681.390316:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267912832:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844681.390436:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed54f2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788844681.393203:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844681.393319:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244858112 00000100:00100000:1.0:1788844681.393333:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244858112 00000100:00100000:1.0:1788844681.393410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 234 00000100:00100000:1.0:1788844681.393433:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+27:11621:x1875739244858112:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788844681.393461:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844681.393490:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da217 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fcba expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.393670:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2da21e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.393689:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2da21e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.393704:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2da21e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844681.393928:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788844681.394113:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da217 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcba expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.394137:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2da21e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcba expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.394169:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844681.394173:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788844681.394177:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.394186:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844681.394194:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60e00, rc 0) 00000100:00100000:1.0:1788844681.394264:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:11621:x1875739244858112:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 833us (1073us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788844681.394273:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 234 00000100:00100000:1.0:1788844681.398494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844681.398665:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244858368 00000100:00100000:0.0:1788844681.398678:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244858368 00000100:00100000:0.0:1788844681.398750:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:0.0:1788844681.398761:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:5596:x1875739244858368:12345-192.168.204.43@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788844681.399101:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:5596:x1875739244858368:12345-192.168.204.43@tcp:35:ldlm_bl.0 Request processed in 340us (621us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788844681.399111:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 63 00000100:00100000:2.0:1788844681.400616:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875739267912832:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844681.400654:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844681.401184:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844681.402131:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244858624 00000100:00100000:2.0:1788844681.402144:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244858624 00000100:00100000:2.0:1788844681.402208:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 235 00000100:00100000:2.0:1788844681.402220:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:11621:x1875739244858624:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788844681.402317:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2da22c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.402340:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2da22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.402354:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2da22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.402658:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2da22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.402669:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2da22c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.402678:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2da22c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.402706:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844681.402722:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2da22c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.402733:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2da22c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.402749:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:2.0:1788844681.402753:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788844681.402759:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2da22c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.402766:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64c00/0x7f1093851e2da22c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.403117:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844681.404691:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:11621:x1875739244858624:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 2459us (3496us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788844681.404705:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 235 00000040:00080000:1.0:1788844681.405248:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788844681.405255:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788844681.406091:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788844681.406108:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788844681.408286:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844681.410134:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844681.410425:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244859008 00000100:00100000:1.0:1788844681.410440:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244859008 00010000:00010000:1.0:1788844681.410496:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc74 expref: 31 pid: 5839 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844681.410706:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00100000:2.0:1788844681.410731:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+31:2354:x1875739244859008:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844681.410754:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844681.410763:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc74 expref: 31 pid: 5839 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.410789:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc74 expref: 31 pid: 5839 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.410819:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031600/0x7f1093851e2da11b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc74 expref: 31 pid: 5839 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.410842:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:2.0:1788844681.410867:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.410880:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.410889:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844681.410920:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844681.410990:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:2354:x1875739244859008:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 262us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844681.410999:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 87 00010000:00010000:3.0:1788844681.411389:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411400:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844681.411455:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788844681.411460:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844681.411486:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411498:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411508:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2da202 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411514:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2da202 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411566:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2da202 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411575:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844681.411580:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2da202 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411590:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2da202 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411602:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:3.0:1788844681.411605:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844681.411610:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2da202 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411615:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65a00/0x7f1093851e2da202 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411629:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411636:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411642:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411647:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844681.411650:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411670:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411680:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91eec2f43800) 00010000:00010000:3.0:1788844681.411682:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844681.411686:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da209 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411691:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411749:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2da1fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcb3 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411765:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcb3 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844681.411773:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844681.411776:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788844681.412256:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65200, rc 0) 00000100:00100000:3.0:1788844681.412316:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:11623:x1875739244857856:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 22679us (23270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844681.412325:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 233 00000100:00100000:0.0:1788844681.415274:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244858880 00000100:00100000:0.0:1788844681.415298:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244858880 00000100:00100000:0.0:1788844681.415385:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 64 00000100:00100000:0.0:1788844681.415408:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+29:11621:x1875739244858880:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788844681.415820:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:11621:x1875739244858880:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 422us (7545us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788844681.415830:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 64 00010000:00010000:2.0:1788844682.426977:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788844682.434824:0:12560:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788844682.434836:0:12560:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788844682.435128:0:12560:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788844682.435135:0:12560:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788844682.639825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844682.639976:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244859264 00000100:00100000:3.0:1788844682.640003:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244859264 00000100:00100000:3.0:1788844682.640112:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 236 00000100:00100000:3.0:1788844682.640127:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+30:11646:x1875739244859264:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844682.640161:0:8217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844682.640188:0:8217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da233 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fcc1 expref: -99 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844682.640339:0:8217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da23a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788844682.640342:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788844682.640362:0:8217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da23a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844682.640379:0:8217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da23a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844682.640452:0:8217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788844682.640891:0:8217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025c00/0x7f1093851e2da233 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcc1 expref: 33 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844682.640915:0:8217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da23a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcc1 expref: 32 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844682.640926:0:8217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:3.0:1788844682.640929:0:8217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788844682.640934:0:8217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0025200, rc 0) 00000100:00100000:3.0:1788844682.641017:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:11646:x1875739244859264:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 893us (1209us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788844682.641037:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 236 00000100:00100000:0.0:1788844682.646178:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844682.646229:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244859392 00000100:00100000:0.0:1788844682.646238:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244859392 00000100:00100000:0.0:1788844682.646316:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 237 00000100:00100000:0.0:1788844682.646341:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:11646:x1875739244859392:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:0.0:1788844682.646422:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da248 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844682.646442:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844682.646465:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844682.646495:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844682.646502:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da248 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844682.646508:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844682.646515:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844682.646520:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844682.646528:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da248 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844682.647241:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:0.0:1788844682.647246:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788844682.647251:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da248 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844682.647257:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030c00/0x7f1093851e2da248 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844682.647336:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:11646:x1875739244859392:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 1004us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844682.647345:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 237 00000100:00100000:0.0:1788844682.744242:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844682.744637:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244859520 00000100:00100000:2.0:1788844682.744650:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244859520 00000100:00100000:2.0:1788844682.744725:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00100000:2.0:1788844682.744735:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244859520:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:2.0:1788844682.744754:0:7066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844682.744775:0:7066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da24f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fcc8 expref: -99 pid: 7066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788844682.744802:0:7066:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f9a87, atime: 0x6a9f9a87, ctime: 0x6a9f9a87, blocks: 0xb 00010000:00010000:2.0:1788844682.744823:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1788844682.744828:0:7066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844682.744837:0:7066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da24f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcc8 expref: 8 pid: 7066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844682.744871:0:7066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da24f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcc8 expref: 8 pid: 7066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844682.744885:0:7066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64000, rc 0) 00000100:00100000:2.0:1788844682.744945:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2355:x1875739244859520:12345-192.168.204.43@tcp:101:cat.0 Request processed in 212us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844682.744952:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 73 00000100:00080000:1.0:1788844682.745294:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844682.754719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844682.755093:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244859648 00000100:00100000:3.0:1788844682.755111:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244859648 00002000:00100000:3.0:1788844682.755184:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91eeff31c000 x1875739244859648/t0(0) o3->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:543/0 lens 488/0 e 0 to 0 dl 1788844693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788844682.755196:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eeff31c000 with x1875739244859648 ext(0->4095) 00002000:00010000:3.0:1788844682.755203:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eeff31c000 00000100:00100000:3.0:1788844682.755307:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:3.0:1788844682.755321:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244859648:12345-192.168.204.43@tcp:3:cat.0 00000100:00100000:2.0:1788844682.756672:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2354:x1875739244859648:12345-192.168.204.43@tcp:3:cat.0 Request processed in 1342us (1959us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788844682.756686:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00002000:00100000:2.0:1788844682.756697:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91eeff31c000 x1875739244859648/t0(0) o3->6c5b824a-0ed7-4d17-82b7-41b1d891d7f1@192.168.204.43@tcp:543/0 lens 488/4536 e 0 to 0 dl 1788844693 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788844682.756708:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91eeff31c000 with x1875739244859648 ext(0->4095) 00002000:00010000:2.0:1788844682.756715:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91eeff31c000 00000001:00080000:2.0:1788844683.137111:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788844683.137147:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1788844683.204832:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844683.204887:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844683.204980:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844683.205011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844683.205074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844683.205142:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244860288 00000100:00100000:1.0:1788844683.205156:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244860288 00000100:00100000:1.0:1788844683.205239:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244859904 00000100:00100000:1.0:1788844683.205243:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244859904 00000100:00100000:1.0:1788844683.205307:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 184 00000100:00100000:1.0:1788844683.205320:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2357:x1875739244860288:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844683.205435:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:89582201-bdf6-4401-b202-b9313c368ae5+5:2357:x1875739244860288:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 117us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844683.205445:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 184 00000100:00100000:1.0:1788844683.205476:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 185 00000100:00100000:1.0:1788844683.205486:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:2357:x1875739244859904:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844683.205514:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+32:2357:x1875739244859904:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844683.205521:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 185 00000100:00080000:1.0:1788844683.205578:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844683.205817:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244859776 00000100:00100000:3.0:1788844683.205824:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244859776 00000100:00100000:3.0:1788844683.205865:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 309 00000100:00100000:3.0:1788844683.205872:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244859776:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844683.205904:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244859776:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 34us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844683.205911:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 309 00000100:00100000:2.0:1788844683.214078:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244860032 00000100:00100000:2.0:1788844683.214098:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244860032 00000100:00100000:2.0:1788844683.218268:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244860160 00000100:00100000:2.0:1788844683.218296:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244860160 00000100:00080000:3.0:1788844683.218392:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788844683.223975:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 107 00000100:00100000:2.0:1788844683.224012:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2357:x1875739244860032:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844683.224161:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+8:2357:x1875739244860032:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 168us (19271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844683.224202:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 107 00000100:00100000:2.0:1788844683.224396:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 108 00000100:00100000:2.0:1788844683.224406:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244860160:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844683.224446:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244860160:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 42us (19393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844683.224453:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 108 00010000:00010000:3.0:1788844683.453220:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844683.523197:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc1908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267913088:0@lo:400:kworker.0 00000100:00100000:0.0:1788844683.523244:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec31fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267913344:0@lo:400:kworker.0 00000100:00100000:0.0:1788844683.523340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844683.523373:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844683.523438:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788844683.523445:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267912960:0@lo:400:kworker.0 00000100:00100000:0.0:1788844683.523479:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844683.523518:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267913472:0@lo:400:kworker.0 00000100:00100000:2.0:1788844683.523562:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844683.523573:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec31fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267913216:0@lo:400:kworker.0 00000100:00100000:0.0:1788844683.523575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844683.523805:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267912960 00000100:00100000:0.0:1788844683.523816:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267912960 00000100:00100000:0.0:1788844683.523878:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788844683.523888:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267912960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844683.523932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844683.523949:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267912960:12345-0@lo:400:kworker.0 Request processed in 60us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844683.523958:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788844683.524028:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267912960:0@lo:400:kworker.0 00000100:00100000:2.0:1788844683.524045:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267913088 00000100:00100000:2.0:1788844683.524052:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267913088 00000100:00100000:0.0:1788844683.524077:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267913472 00000100:00100000:0.0:1788844683.524082:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267913472 00000100:00100000:2.0:1788844683.524089:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267913216 00000100:00100000:2.0:1788844683.524093:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267913216 00000100:00100000:2.0:1788844683.524117:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788844683.524122:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267913088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844683.524135:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788844683.524145:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267913216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844683.524174:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267913088:12345-0@lo:400:kworker.0 Request processed in 52us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844683.524181:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788844683.524194:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267913216:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844683.524197:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788844683.524205:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267913472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844683.524223:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788844683.524234:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267913472:12345-0@lo:400:kworker.0 Request processed in 28us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844683.524239:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1788844683.524254:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844683.524284:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267913472:0@lo:400:kworker.0 00000100:00100000:3.0:1788844683.524445:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267913344 00000100:00100000:3.0:1788844683.524451:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267913344 00000100:00100000:3.0:1788844683.524495:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788844683.524752:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec31fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267913216:0@lo:400:kworker.0 00000100:00100000:2.0:1788844683.524763:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc1908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267913088:0@lo:400:kworker.0 00000100:00080000:0.0:1788844683.524765:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844683.524874:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875739267913344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844683.524941:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875739267913344:12345-0@lo:400:kworker.0 Request processed in 439us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844683.524948:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788844683.525676:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788844683.525696:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267913600:0@lo:400:kworker.0 00000100:00100000:1.0:1788844683.525749:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844683.525793:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267913600 00000100:00100000:1.0:1788844683.525800:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267913600 00000100:00100000:1.0:1788844683.525844:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788844683.525852:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267913600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844683.525895:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267913600:12345-0@lo:400:kworker.0 Request processed in 43us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844683.525901:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788844683.525933:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788844683.525940:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788844683.525962:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91edc2f87480, transno 4294967310 00000100:00100000:1.0:1788844683.525978:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267913600:0@lo:400:kworker.0 00000100:00100000:2.0:1788844683.531007:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec31fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267913344:0@lo:400:kworker.0 00000100:00080000:0.0:1788844683.531586:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788844684.033184:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844684.033216:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc1908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267913728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844684.033309:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844684.033572:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267913728 00000100:00100000:2.0:1788844684.033582:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267913728 00000100:00100000:2.0:1788844684.033654:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788844684.033665:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267913728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788844684.033712:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844684.033774:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267913728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844684.033782:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788844684.033842:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc1908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267913728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788844684.474926:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844684.543584:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788844684.545783:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267913856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844684.545885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844684.549443:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267913856 00000100:00100000:2.0:1788844684.549469:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267913856 00000100:00100000:2.0:1788844684.549775:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788844684.549789:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267913856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844684.549841:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844684.549948:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267913856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (4063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844684.549957:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788844684.550075:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267913856:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788844685.503425:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788844685.503438:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788844685.503495:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788844685.503503:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788844685.503740:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788844686.219297:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000001:00080000:1.0:1788844686.219345:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788844686.219357:0:5861:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91eec2c67240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788844686.219362:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eec59f6f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91eec2c67000 00000020:00080000:1.0:1788844686.219366:0:5861:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91eec59f6b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91eed22d7800 00000020:00080000:1.0:1788844686.219396:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788844686.219437:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788844686.219896:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788844686.522014:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788844686.683571:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788844686.683594:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:3.0:1788844687.545922:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844688.329081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844688.329143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844688.329185:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844688.329221:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844688.329251:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844688.329348:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244860800 00000100:00100000:3.0:1788844688.329363:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244860800 00000100:00100000:3.0:1788844688.329455:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244860672 00000100:00100000:3.0:1788844688.329460:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244860672 00000100:00100000:3.0:1788844688.329487:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 111 00000100:00100000:3.0:1788844688.329499:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244860800:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844688.329654:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2354:x1875739244860800:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 157us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844688.329663:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 111 00000100:00100000:3.0:1788844688.329684:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 112 00000100:00100000:3.0:1788844688.329691:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244860672:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844688.329717:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2354:x1875739244860672:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 27us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844688.329723:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 112 00000100:00080000:0.0:1788844688.329854:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844688.329860:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788844688.329934:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244860416 00000100:00100000:2.0:1788844688.329940:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244860416 00000100:00100000:2.0:1788844688.329983:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 311 00000100:00100000:2.0:1788844688.329991:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244860416:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844688.330044:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244860416:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 53us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844688.330052:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 311 00000100:00100000:2.0:1788844688.330091:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244860544 00000100:00100000:2.0:1788844688.330095:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244860544 00000100:00100000:2.0:1788844688.330141:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244860928 00000100:00100000:2.0:1788844688.330144:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244860928 00000100:00100000:2.0:1788844688.330164:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 189 00000100:00100000:2.0:1788844688.330170:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2354:x1875739244860544:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844688.330202:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2354:x1875739244860544:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 33us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844688.330209:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 189 00000100:00100000:2.0:1788844688.330221:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 190 00000100:00100000:2.0:1788844688.330228:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244860928:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844688.330253:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+5:2354:x1875739244860928:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 25us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844688.330259:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 190 00000100:00080000:3.0:1788844688.330802:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844688.374692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844688.374836:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244861056 00000100:00100000:2.0:1788844688.374852:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244861056 00000100:00100000:2.0:1788844688.375005:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 238 00000100:00100000:2.0:1788844688.375018:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:11298:x1875739244861056:12345-192.168.204.43@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788844688.375172:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:11298:x1875739244861056:12345-192.168.204.43@tcp:60:lhsmtool_posix.0 Request processed in 156us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844688.375181:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 238 00000100:00100000:2.0:1788844688.386786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844688.386907:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244861312 00000100:00100000:0.0:1788844688.386931:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244861312 00000100:00100000:0.0:1788844688.387013:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 65 00000100:00100000:0.0:1788844688.387025:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc1908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:11298:x1875739244861312:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788844688.387765:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc1908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:11298:x1875739244861312:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 739us (1171us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788844688.387775:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 65 00010000:00010000:3.0:1788844688.577381:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844688.637944:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844688.637985:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267914240:0@lo:400:kworker.0 00000100:00100000:1.0:1788844688.637986:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267914368:0@lo:400:kworker.0 00000100:00100000:0.0:1788844688.638055:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267914496:0@lo:400:kworker.0 00000100:00100000:2.0:1788844688.638163:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267914112:0@lo:400:kworker.0 00000100:00100000:1.0:1788844688.645200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844688.645302:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267913984:0@lo:400:kworker.0 00000100:00100000:1.0:1788844688.645347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844688.645443:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267913984 00000100:00100000:1.0:1788844688.645453:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267913984 00000100:00100000:1.0:1788844688.645517:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788844688.645620:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267913984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844688.645685:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267913984:12345-0@lo:400:kworker.0 Request processed in 159us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844688.645693:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788844688.645818:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267913984:0@lo:400:kworker.0 00000100:00100000:1.0:1788844688.645889:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267914368 00000100:00100000:1.0:1788844688.645893:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267914368 00000100:00100000:1.0:1788844688.648836:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788844688.648865:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267914368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844688.649433:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844688.649554:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267914240 00000100:00100000:3.0:1788844688.649567:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267914240 00000100:00100000:3.0:1788844688.649631:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788844688.649640:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267914240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844688.649687:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267914240:12345-0@lo:400:kworker.0 Request processed in 48us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844688.649695:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788844688.649766:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267914240:0@lo:400:kworker.0 00000100:00080000:3.0:1788844688.649811:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788844688.649818:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844688.651053:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788844688.651068:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788844688.651096:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267914368:0@lo:400:kworker.0 00000100:00100000:1.0:1788844688.651404:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267914368:12345-0@lo:400:kworker.0 Request processed in 215us (3878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844688.651424:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788844688.652393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844688.653827:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844688.654502:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267914624:0@lo:400:kworker.0 00000100:00100000:2.0:1788844688.654707:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844688.655011:0:7066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267914624 00000100:00100000:0.0:1788844688.655024:0:7066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267914624 00000100:00100000:0.0:1788844688.655121:0:7066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788844688.655133:0:7066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267914624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844688.655204:0:7066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267914624:12345-0@lo:400:kworker.0 Request processed in 74us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844688.655212:0:7066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1788844688.655358:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788844688.655399:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267914624:0@lo:400:kworker.0 00000100:00100000:1.0:1788844688.658071:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267914496 00000100:00100000:1.0:1788844688.658095:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267914496 00000100:00080000:2.0:1788844688.658213:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844688.658288:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267914112 00000100:00100000:1.0:1788844688.658293:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267914112 00000100:00100000:1.0:1788844688.658412:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788844688.658426:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267914496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844688.658461:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788844688.658477:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec31fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267914112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844688.658665:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267914112:0@lo:400:kworker.0 00000100:00100000:0.0:1788844688.660275:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267914496:0@lo:400:kworker.0 00000100:00100000:1.0:1788844688.665969:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875739267914496:12345-0@lo:400:kworker.0 Request processed in 7527us (13561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844688.665993:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788844688.670776:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec31fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267914112:12345-0@lo:400:kworker.0 Request processed in 12285us (16940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844688.670796:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788844688.715755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844688.715953:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244861440 00000100:00100000:2.0:1788844688.715969:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244861440 00000100:00100000:2.0:1788844688.716055:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 239 00000100:00100000:2.0:1788844688.716069:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89582201-bdf6-4401-b202-b9313c368ae5+5:12100:x1875739244861440:12345-192.168.204.43@tcp:101:lsof.0 00010000:00010000:2.0:1788844688.716100:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844688.716131:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da256 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fccf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844688.716755:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2da25d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844688.716777:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2da25d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844688.716792:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2da25d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844688.716841:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788844688.716846:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844688.716876:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2da25d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844688.716942:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64e00/0x7f1093851e2da256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fccf expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844688.716966:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2da25d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fccf expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844688.716976:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:2.0:1788844688.716980:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844688.716985:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65800, rc 0) 00000100:00100000:2.0:1788844688.717068:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89582201-bdf6-4401-b202-b9313c368ae5+6:12100:x1875739244861440:12345-192.168.204.43@tcp:101:lsof.0 Request processed in 1001us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844688.717076:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 239 00000100:00100000:3.0:1788844689.146111:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeefc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267914752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844689.146314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844689.147619:0:12522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267914752 00000100:00100000:1.0:1788844689.147635:0:12522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267914752 00000100:00100000:1.0:1788844689.147714:0:12522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788844689.147726:0:12522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267914752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788844689.148802:0:12522:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844689.148968:0:12522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267914752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1240us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844689.148981:0:12522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788844689.152613:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeefc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267914752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788844689.594218:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844689.657900:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788844689.657933:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267914880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844689.658026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844689.658354:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267914880 00000100:00100000:2.0:1788844689.658365:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267914880 00000100:00100000:2.0:1788844689.658474:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788844689.658486:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267914880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844689.658563:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844689.658634:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267914880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844689.658642:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788844689.661379:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267914880:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788844690.619638:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788844691.288735:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788844691.288767:0:5861:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788844691.288839:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788844691.288854:0:5872:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788844691.642189:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844692.669377:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788844693.413036:0:12762:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:18:10 (1788844690) 00000100:00100000:0.0:1788844693.447224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844693.447482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844693.447527:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844693.447573:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844693.447603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844693.447607:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244861952 00000100:00100000:2.0:1788844693.447889:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244861952 00000100:00100000:2.0:1788844693.447978:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244861824 00000100:00100000:2.0:1788844693.447982:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244861824 00000100:00100000:2.0:1788844693.448010:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:2.0:1788844693.448023:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244861952:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844693.448137:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2357:x1875739244861952:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 116us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844693.448146:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 115 00000100:00100000:2.0:1788844693.448169:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00100000:2.0:1788844693.448176:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb3dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2357:x1875739244861824:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844693.448204:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb3dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2357:x1875739244861824:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 29us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844693.448211:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 116 00000100:00080000:2.0:1788844693.448232:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788844693.448237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788844693.462368:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244861568 00000100:00100000:0.0:1788844693.462395:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244861568 00000100:00100000:0.0:1788844693.462481:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 313 00000100:00100000:0.0:1788844693.462503:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244861568:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844693.462634:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2357:x1875739244861568:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 134us (15106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844693.462642:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 313 00000100:00100000:1.0:1788844693.462844:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244861696 00000100:00100000:1.0:1788844693.462850:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244861696 00000100:00100000:0.0:1788844693.463048:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244862080 00000100:00100000:0.0:1788844693.463054:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244862080 00000100:00100000:0.0:1788844693.463121:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 194 00000100:00100000:0.0:1788844693.463131:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+6:2357:x1875739244862080:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844693.463175:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+6:2357:x1875739244862080:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 47us (15571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844693.463182:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 194 00000100:00080000:1.0:1788844693.463422:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788844693.467010:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844693.467120:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 195 00000100:00100000:0.0:1788844693.467135:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2357:x1875739244861696:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844693.467261:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2357:x1875739244861696:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 130us (20054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844693.467269:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 195 00010000:00010000:0.0:1788844693.696270:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844693.754589:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267915008:0@lo:400:kworker.0 00000100:00100000:2.0:1788844693.754691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844693.766478:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788844693.766506:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267915392:0@lo:400:kworker.0 00000100:00100000:2.0:1788844693.766623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844693.766764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267915008 00000100:00100000:2.0:1788844693.766775:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267915008 00000100:00100000:2.0:1788844693.766851:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788844693.766863:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267915008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844693.766931:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3306:x1875739267915008:12345-0@lo:400:kworker.0 Request processed in 70us (12240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844693.766940:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788844693.766995:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267915392 00000100:00100000:2.0:1788844693.766999:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267915392 00000100:00100000:2.0:1788844693.767149:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788844693.767157:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267915392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844693.767208:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeefc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267915392:12345-0@lo:400:kworker.0 Request processed in 52us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844693.767215:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788844693.767282:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267915392:0@lo:400:kworker.0 00000100:00100000:2.0:1788844693.767297:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3306:1875739267915008:0@lo:400:kworker.0 00000100:00080000:2.0:1788844693.767401:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844693.767583:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844693.767597:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267915520:0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.767636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844693.767674:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267915136:0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.767701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844693.767721:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267915648:0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.767756:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844693.767779:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788844693.767786:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267915264:0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.767823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844693.767877:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267915520 00000100:00100000:3.0:1788844693.767882:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267915520 00000100:00100000:3.0:1788844693.767918:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267915136 00000100:00100000:3.0:1788844693.767922:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267915136 00000100:00100000:3.0:1788844693.767934:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267915264 00000100:00100000:3.0:1788844693.767937:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267915264 00000100:00100000:3.0:1788844693.768397:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788844693.768407:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267915520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.768463:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267915520:12345-0@lo:400:kworker.0 Request processed in 58us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844693.768471:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788844693.768493:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788844693.768500:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267915136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.768557:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267915136:12345-0@lo:400:kworker.0 Request processed in 35us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844693.768565:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788844693.768577:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788844693.768583:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267915264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.768612:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267915264:12345-0@lo:400:kworker.0 Request processed in 30us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844693.768618:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788844693.768642:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267915648 00000100:00100000:3.0:1788844693.768647:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267915648 00000100:00100000:3.0:1788844693.768688:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788844693.768694:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267915648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.768727:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267915648:12345-0@lo:400:kworker.0 Request processed in 34us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844693.768734:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788844693.768776:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267915520:0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.768822:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267915264:0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.768836:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267915136:0@lo:400:kworker.0 00000100:00100000:3.0:1788844693.768845:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267915648:0@lo:400:kworker.0 00000100:00080000:2.0:1788844693.770573:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788844693.770586:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844694.265938:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267915776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844694.266038:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844694.266609:0:12522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267915776 00000100:00100000:2.0:1788844694.266620:0:12522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267915776 00000100:00100000:2.0:1788844694.266683:0:12522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788844694.266696:0:12522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267915776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788844694.266747:0:12522:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844694.266837:0:12522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267915776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844694.266845:0:12522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788844694.267427:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267915776:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788844694.719525:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844694.780530:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788844694.780593:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267915904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844694.780708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844694.780812:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267915904 00000100:00100000:2.0:1788844694.780822:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267915904 00000100:00100000:2.0:1788844694.780883:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788844694.780893:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267915904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844694.780941:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844694.780995:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267915904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844694.781015:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788844694.781079:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267915904:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788844695.737976:0:11673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788844695.737991:0:11673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788844695.738598:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788844695.738608:0:11673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788844695.742670:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844696.761788:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844697.785893:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844698.572438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844698.572734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844698.572778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844698.572807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844698.572844:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844698.572915:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244862208 00000100:00100000:1.0:1788844698.572929:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244862208 00000100:00100000:1.0:1788844698.572997:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 315 00000100:00100000:1.0:1788844698.573009:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2355:x1875739244862208:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844698.573103:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2355:x1875739244862208:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844698.573112:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 315 00000100:00100000:1.0:1788844698.573307:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244862592 00000100:00100000:1.0:1788844698.573313:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244862592 00000100:00100000:1.0:1788844698.573353:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244862464 00000100:00100000:1.0:1788844698.573357:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244862464 00000100:00100000:1.0:1788844698.573380:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:1.0:1788844698.573387:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2355:x1875739244862592:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844698.573423:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2355:x1875739244862592:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 37us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844698.573431:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:1.0:1788844698.573444:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:1.0:1788844698.573451:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244862464:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844698.573489:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2355:x1875739244862464:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 39us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844698.573496:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00080000:1.0:1788844698.573523:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788844698.573528:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788844698.593988:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244862336 00000100:00100000:3.0:1788844698.594010:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244862336 00000100:00100000:3.0:1788844698.594107:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244862720 00000100:00100000:3.0:1788844698.594110:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244862720 00000100:00100000:3.0:1788844698.594154:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 199 00000100:00100000:3.0:1788844698.594165:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2355:x1875739244862336:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844698.594283:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:2355:x1875739244862336:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 120us (21861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844698.594313:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 199 00000100:00100000:3.0:1788844698.594334:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 200 00000100:00100000:3.0:1788844698.594341:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec4ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+6:2355:x1875739244862720:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844698.594369:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec4ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:89582201-bdf6-4401-b202-b9313c368ae5+6:2355:x1875739244862720:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 28us (21524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844698.594375:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 200 00000100:00080000:3.0:1788844698.594406:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844698.594623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844698.596022:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244862976 00000100:00100000:3.0:1788844698.596040:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244862976 00000100:00100000:3.0:1788844698.596165:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:3.0:1788844698.596175:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+19:12322:x1875739244862976:12345-192.168.204.43@tcp:35:umount.0 00000100:00100000:3.0:1788844698.596715:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:12322:x1875739244862976:12345-192.168.204.43@tcp:35:umount.0 Request processed in 539us (2091us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788844698.596735:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 66 00000100:00100000:1.0:1788844698.607519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844698.607962:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244863232 00000100:00100000:0.0:1788844698.607995:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244863232 00000100:00100000:0.0:1788844698.608073:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 67 00000100:00100000:0.0:1788844698.608091:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+20:12322:x1875739244863232:12345-192.168.204.43@tcp:35:umount.0 00000100:00100000:0.0:1788844698.608938:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:12322:x1875739244863232:12345-192.168.204.43@tcp:35:umount.0 Request processed in 841us (1428us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788844698.608950:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 67 00000100:00100000:0.0:1788844698.612233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844698.616870:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244863488 00000100:00100000:1.0:1788844698.616892:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244863488 00000100:00100000:1.0:1788844698.617017:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:1.0:1788844698.617030:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeddc9bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+21:12322:x1875739244863488:12345-192.168.204.43@tcp:35:umount.0 00000100:00100000:1.0:1788844698.617402:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeddc9bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:12322:x1875739244863488:12345-192.168.204.43@tcp:35:umount.0 Request processed in 373us (5184us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788844698.617410:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 68 00000100:00100000:0.0:1788844698.636280:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844698.637894:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244863744 00000100:00100000:3.0:1788844698.637915:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244863744 00000100:00100000:3.0:1788844698.638013:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:3.0:1788844698.638024:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:12322:x1875739244863744:12345-192.168.204.43@tcp:35:umount.0 00000100:00100000:3.0:1788844698.638517:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:12322:x1875739244863744:12345-192.168.204.43@tcp:35:umount.0 Request processed in 492us (2275us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788844698.638526:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 69 00000100:00100000:2.0:1788844698.646533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844698.646798:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844698.646821:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844698.646923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844698.653757:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244864128 00000100:00100000:3.0:1788844698.653780:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244864128 00000100:00100000:2.0:1788844698.654009:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244864000 00000100:00100000:2.0:1788844698.654014:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244864000 00000100:00100000:2.0:1788844698.654029:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244864256 00000100:00100000:2.0:1788844698.654033:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244864256 00000100:00100000:2.0:1788844698.654058:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:2.0:1788844698.654069:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+15:2354:x1875739244864128:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844698.654092:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844698.654120:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0024800/0x7f1093851e2d9234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f822 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844698.654144:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844698.654239:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+14:2354:x1875739244864128:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 171us (7722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844698.654249:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:2.0:1788844698.654269:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:2.0:1788844698.654276:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+13:2354:x1875739244864000:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844698.654284:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844698.654295:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5527400/0x7f1093851e2d92ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f85a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844698.654341:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844698.654362:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:2354:x1875739244864000:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 87us (7564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844698.654369:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:2.0:1788844698.654382:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1788844698.654388:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:2354:x1875739244864256:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844698.654396:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844698.654405:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0031200/0x7f1093851e2d94b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f925 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844698.654415:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844698.654431:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244864256:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 43us (7609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844698.654436:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:1.0:1788844698.658783:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244863872 00000100:00100000:1.0:1788844698.658809:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244863872 00000100:00100000:1.0:1788844698.658906:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 74 00000100:00100000:1.0:1788844698.658920:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2353:x1875739244863872:12345-192.168.204.43@tcp:9:umount.0 00000020:00000080:1.0:1788844698.658972:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9c52 00000100:00080000:1.0:1788844698.658986:0:6686:0:(import.c:65:import_set_state_nolock()) ffff91eec2c39000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788844698.659056:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788844698.659747:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+2:2353:x1875739244863872:12345-192.168.204.43@tcp:9:umount.0 Request processed in 824us (12817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844698.659760:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 74 00010000:00010000:3.0:1788844698.662465:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844698.676894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844698.676996:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244864640 00000100:00100000:3.0:1788844698.677032:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244864640 00000100:00100000:3.0:1788844698.677112:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:3.0:1788844698.677124:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+7:2353:x1875739244864640:12345-192.168.204.43@tcp:9:umount.0 00000020:00000080:3.0:1788844698.677171:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d980e 00000020:00010000:3.0:1788844698.677183:0:6688:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91eed83d3000: total 0 00000100:00080000:3.0:1788844698.677188:0:6688:0:(import.c:65:import_set_state_nolock()) ffff91eed83d6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788844698.677252:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788844698.677646:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+5:2353:x1875739244864640:12345-192.168.204.43@tcp:9:umount.0 Request processed in 523us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844698.677655:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 75 00000020:00010000:1.0:1788844698.678102:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91eed83d3000: total 0 00010000:00010000:1.0:1788844698.678139:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91eed83d3000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788844698.678212:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c1e2691/0x7f1093851e2da24f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcc8 expref: 4 pid: 7066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.678256:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001955aa53/0x7f1093851e2d9baa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fafa expref: 3 pid: 7066 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.678293:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91eed83d3000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788844698.678307:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844698.678310:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844698.678311:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844698.697837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844698.699603:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244865664 00000100:00100000:3.0:1788844698.699625:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244865664 00000100:00100000:3.0:1788844698.699746:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 240 00000100:00100000:3.0:1788844698.699760:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+23:2353:x1875739244865664:12345-192.168.204.43@tcp:39:umount.0 00000020:00000080:3.0:1788844698.699808:0:8217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9242 00000020:00010000:3.0:1788844698.699830:0:8217:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91eefb387000: total 0 00000100:00080000:3.0:1788844698.699837:0:8217:0:(import.c:65:import_set_state_nolock()) ffff91eefb382000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788844698.699888:0:8217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788844698.700503:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6c5b824a-0ed7-4d17-82b7-41b1d891d7f1+22:2353:x1875739244865664:12345-192.168.204.43@tcp:39:umount.0 Request processed in 740us (2679us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788844698.700513:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 240 00000020:00010000:1.0:1788844698.700762:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91eefb387000: total 0 00010000:00010000:1.0:1788844698.700768:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844698.700826:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91eefb387000, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1788844698.700871:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:1.0:1788844698.700875:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788844698.700888:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030800/0x7f1093851e2d9c0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb16 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.700912:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eed38cf700) 00010000:00010000:1.0:1788844698.700915:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844698.700920:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2d9528 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f93a expref: 20 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.700944:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:1.0:1788844698.700946:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788844698.700950:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64800/0x7f1093851e2d9b95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faf3 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.700965:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844698.700967:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844698.700970:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65200/0x7f1093851e2da210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcb3 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701013:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844698.701015:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788844698.701019:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da23a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcc1 expref: 17 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701031:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:1.0:1788844698.701034:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844698.701036:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2d9b6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fae5 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701050:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:1.0:1788844698.701052:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788844698.701055:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2d9f0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fbef expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701066:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:1.0:1788844698.701068:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788844698.701071:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031a00/0x7f1093851e2d9869 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fa21 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701082:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eec2f43600) 00010000:00010000:1.0:1788844698.701084:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788844698.701088:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65c00/0x7f1093851e2d950c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f933 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701104:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91eec2f43400) 00010000:00010000:1.0:1788844698.701106:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788844698.701115:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d64200/0x7f1093851e2d9c28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fb1d expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701131:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91eec2f43c00) 00010000:00010000:1.0:1788844698.701133:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788844698.701137:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0205d400/0x7f1093851e2d9a8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793faad expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701153:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91eed38cf800) 00010000:00010000:1.0:1788844698.701155:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788844698.701159:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025e00/0x7f1093851e2d957c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f94f expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701175:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844698.701177:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788844698.701181:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65400/0x7f1093851e2da130 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fc7b expref: 9 pid: 8217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701192:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91eee1796900) 00010000:00010000:1.0:1788844698.701195:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788844698.701197:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60e00/0x7f1093851e2da21e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fcba expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844698.701211:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91eefb387000, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1788844698.701223:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844698.701225:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844698.701226:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844698.809890:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844698.874854:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844698.874890:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eed8286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267916032:0@lo:400:kworker.0 00000100:00100000:3.0:1788844698.875009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844698.875682:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267916032 00000100:00100000:2.0:1788844698.875696:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267916032 00000100:00100000:2.0:1788844698.875770:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788844698.875782:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267916032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844698.875874:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267916032:12345-0@lo:400:kworker.0 Request processed in 93us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844698.875883:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788844698.875950:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267916160:0@lo:400:kworker.0 00000100:00100000:3.0:1788844698.875972:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267916416:0@lo:400:kworker.0 00000100:00100000:2.0:1788844698.875991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844698.876019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844698.876024:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267916672:0@lo:400:kworker.0 00000100:00100000:3.0:1788844698.876064:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eed8286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267916032:0@lo:400:kworker.0 00000100:00100000:2.0:1788844698.876072:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844698.876102:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844698.876110:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267916544:0@lo:400:kworker.0 00000100:00100000:2.0:1788844698.876114:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788844698.876122:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267916288:0@lo:400:kworker.0 00000100:00100000:3.0:1788844698.876144:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844698.876163:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267916416 00000100:00100000:2.0:1788844698.876169:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267916416 00000100:00100000:3.0:1788844698.876188:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267916160 00000100:00100000:3.0:1788844698.876194:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267916160 00000100:00100000:2.0:1788844698.876212:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267916672 00000100:00100000:2.0:1788844698.876216:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267916672 00000100:00100000:3.0:1788844698.876249:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267916544 00000100:00100000:3.0:1788844698.876255:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267916544 00000100:00100000:2.0:1788844698.876255:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788844698.876266:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267916416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844698.876290:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788844698.876298:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267916160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844698.876315:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267916416:12345-0@lo:400:kworker.0 Request processed in 50us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844698.876323:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788844698.876340:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788844698.876344:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267916160:12345-0@lo:400:kworker.0 Request processed in 45us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844698.876353:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267916672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844698.876357:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788844698.876375:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788844698.876385:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed8286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267916544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844698.876393:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267916672:12345-0@lo:400:kworker.0 Request processed in 43us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844698.876402:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788844698.876424:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed8286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267916544:12345-0@lo:400:kworker.0 Request processed in 41us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844698.876431:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:2.0:1788844698.876447:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788844698.876454:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788844698.876456:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844698.876468:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844698.876490:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267916544:0@lo:400:kworker.0 00000100:00100000:2.0:1788844698.876503:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267916160:0@lo:400:kworker.0 00000100:00100000:3.0:1788844698.876509:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267916416:0@lo:400:kworker.0 00000100:00100000:2.0:1788844698.876522:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267916672:0@lo:400:kworker.0 00000100:00100000:3.0:1788844698.876565:0:8217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267916288 00000100:00100000:3.0:1788844698.876570:0:8217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267916288 00000100:00100000:3.0:1788844698.876601:0:8217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788844698.876607:0:8217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267916288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844698.876642:0:8217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267916288:12345-0@lo:400:kworker.0 Request processed in 35us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844698.876660:0:8217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:3.0:1788844698.876674:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844698.876731:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267916288:0@lo:400:kworker.0 00000100:00100000:3.0:1788844699.389174:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788844699.389208:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267916800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844699.389312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844699.389669:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267916800 00000100:00100000:2.0:1788844699.389690:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267916800 00000100:00100000:2.0:1788844699.389790:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788844699.389800:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267916800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788844699.389846:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844699.390271:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267916800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 470us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844699.390280:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788844699.395802:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267916800:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788844699.833914:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844699.897893:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267916928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844699.897998:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844699.898168:0:12522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267916928 00000100:00100000:2.0:1788844699.898180:0:12522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267916928 00000100:00100000:2.0:1788844699.898246:0:12522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788844699.898259:0:12522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267916928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844699.898306:0:12522:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844699.898373:0:12522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267916928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844699.898381:0:12522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788844699.899353:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267916928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844700.608333:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844700.608385:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844700.608437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844700.608508:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244865792 00000100:00100000:0.0:1788844700.608533:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244865792 00000100:00100000:0.0:1788844700.608640:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244866048 00000100:00100000:0.0:1788844700.608643:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244866048 00000100:00100000:0.0:1788844700.608656:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244865920 00000100:00100000:0.0:1788844700.608659:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244865920 00000100:00100000:3.0:1788844700.608671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844700.608674:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:0.0:1788844700.608696:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+12:2354:x1875739244865792:12345-192.168.204.43@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788844700.608708:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244866304 00000100:00100000:3.0:1788844700.608712:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244866304 00010000:00010000:0.0:1788844700.608716:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844700.608753:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526600/0x7f1093851e2d9314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f86f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844700.608776:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844700.608797:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 241 00000100:00100000:3.0:1788844700.608804:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef0170b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89582201-bdf6-4401-b202-b9313c368ae5+6:2353:x1875739244866304:12345-192.168.204.43@tcp:39:umount.0 00000020:00000080:3.0:1788844700.608845:0:5840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9329 00000100:00100000:0.0:1788844700.608850:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+11:2354:x1875739244865792:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 157us (533us total) trans 0 rc 0/0 00000020:00010000:3.0:1788844700.608855:0:5840:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91eec71b5800: total 0 00000100:00100000:0.0:1788844700.608857:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00080000:3.0:1788844700.608860:0:5840:0:(import.c:65:import_set_state_nolock()) ffff91eec71b7000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788844700.608880:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1788844700.608886:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+10:2354:x1875739244866048:12345-192.168.204.43@tcp:103:ldlm_bl.0 00000001:00000004:3.0:1788844700.608892:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:0.0:1788844700.608903:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844700.608914:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bae00/0x7f1093851e2d94b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f91e expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844700.608924:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844700.608944:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+9:2354:x1875739244866048:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 58us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844700.608950:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1788844700.608961:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:0.0:1788844700.608966:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+8:2354:x1875739244865920:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844700.608973:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844700.608981:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526200/0x7f1093851e2d931b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f899 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844700.609001:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844700.609017:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ca16c13-8379-4c1a-af6d-609863f2bd5f+7:2354:x1875739244865920:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 51us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844700.609023:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00080000:0.0:1788844700.609071:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788844700.609082:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91eec71b5800: total 0 00000100:00100000:3.0:1788844700.609117:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef0170b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:89582201-bdf6-4401-b202-b9313c368ae5+5:2353:x1875739244866304:12345-192.168.204.43@tcp:39:umount.0 Request processed in 313us (445us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788844700.609123:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 241 00010000:00010000:0.0:1788844700.609127:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91eec71b5800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788844700.609156:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:0.0:1788844700.609160:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788844700.609167:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d65800/0x7f1093851e2da25d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fccf expref: 4 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844700.609190:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91eec71b5800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788844700.609209:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844700.609212:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844700.609214:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844700.633026:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844700.633165:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244866560 00000100:00100000:1.0:1788844700.633193:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244866560 00000100:00100000:1.0:1788844700.633268:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 317 00000100:00100000:1.0:1788844700.633281:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+7:2353:x1875739244866560:12345-192.168.204.43@tcp:251:umount.0 00000020:00000080:1.0:1788844700.633339:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d921f 00000020:00010000:1.0:1788844700.633348:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91eec5754000: total 0 00000100:00080000:1.0:1788844700.633354:0:5834:0:(import.c:65:import_set_state_nolock()) ffff91eec5752800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788844700.633456:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ca16c13-8379-4c1a-af6d-609863f2bd5f+3:2353:x1875739244866560:12345-192.168.204.43@tcp:251:umount.0 Request processed in 177us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844700.633465:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 317 00000020:00010000:3.0:1788844700.633852:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91eec5754000: total 0 00010000:00010000:3.0:1788844700.633859:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844700.633914:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91eec5754000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788844700.633964:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bb200/0x7f1093851e2d92d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793f861 expref: 2 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844700.634002:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91eec5754000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788844700.634015:0:5827:0:(genops.c:885:class_export_put()) final put ffff91eec5754000/8ca16c13-8379-4c1a-af6d-609863f2bd5f 00010000:00010000:3.0:1788844700.634033:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844700.634036:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844700.634038:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788844700.634197:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec5754000/8ca16c13-8379-4c1a-af6d-609863f2bd5f for MGS 00000020:00000080:2.0:1788844700.634238:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec5752800 for MGS 00010000:00010000:0.0:1788844700.857806:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788844701.511135:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:2.0:1788844701.511168:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1788844701.511177:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 89582201-bdf6-4401-b202-b9313c368ae5 00000001:00080000:2.0:1788844701.511184:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1788844701.511188:0:5861:0:(genops.c:885:class_export_put()) final put ffff91eec71b5800/89582201-bdf6-4401-b202-b9313c368ae5 00000001:00100000:2.0:1788844701.511215:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000001:00080000:2.0:1788844701.511221:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788844701.511229:0:5861:0:(genops.c:885:class_export_put()) final put ffff91eefb387000/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:3.0:1788844701.511287:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec71b5800/89582201-bdf6-4401-b202-b9313c368ae5 for lustre-MDT0000 00000020:00000080:3.0:1788844701.511356:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eefb387000/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 for lustre-MDT0000 00000020:00000080:3.0:1788844701.511392:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec71b7000 for lustre-MDT0000 00000020:00000080:3.0:1788844701.511397:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eefb382000 for lustre-MDT0000 00010000:00010000:3.0:1788844701.885423:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788844702.026288:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:1.0:1788844702.026301:0:6711:0:(genops.c:885:class_export_put()) final put ffff91eed83d3000/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:0.0:1788844702.026384:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eed83d3000/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 for lustre-OST0000 00000020:00000080:0.0:1788844702.026506:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eed83d6800 for lustre-OST0000 00000020:01000004:2.0:1788844702.514459:0:12960:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788844702.541611:0:12960:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788844702.541686:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844702.541705:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844702.541714:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844702.541722:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844702.541750:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788844702.541756:0:12960:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788844702.541794:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788844702.541801:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788844702.541808:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788844702.541841:0:12960:0:(import.c:65:import_set_state_nolock()) ffff91eec6b50800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788844702.542830:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875739267917056:0@lo:39:umount.0 00000100:00100000:3.0:1788844702.542938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788844702.543265:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844702.543275:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.543287:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527e00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844702.543292:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.543303:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844702.543310:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844702.543317:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788844702.543320:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267917056 10000000:01000000:0.0:1788844702.543320:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788844702.543323:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1788844702.543330:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267917056 00010000:00010000:0.0:1788844702.543366:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.543373:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788844702.543685:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788844702.543716:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875739267917056:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788844702.544095:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d902e 00000100:00080000:2.0:1788844702.544117:0:5838:0:(import.c:65:import_set_state_nolock()) ffff91ef013e9000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788844702.544296:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1875739267917056:12345-0@lo:39:umount.0 Request processed in 581us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844702.544304:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00010000:3.0:1788844702.544320:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788844702.544321:0:5838:0:(genops.c:885:class_export_put()) final put ffff91ef013e8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788844702.544355:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91ef013e8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1788844702.544360:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec6b50800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788844702.544372:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875739267917056:0@lo:39:umount.0 00000020:00000080:2.0:1788844702.544410:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ef013e9000 for lustre-MDT0000 00010000:00010000:0.0:1788844702.544589:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.544600:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec5527e00/0x7f1093851e2d92a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d92ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.544627:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844702.544629:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844702.544631:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844702.544650:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788844702.544666:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267917184:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788844702.544960:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788844702.544965:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788844702.544971:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788844702.547794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844702.547851:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267917184 00000100:00100000:2.0:1788844702.547864:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267917184 00000100:00100000:2.0:1788844702.547951:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788844702.547963:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec2d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3305:x1875739267917184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788844702.547987:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844702.548013:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99ba600/0x7f1093851e2d92ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d92a4 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.548031:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844702.548086:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec2d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:3305:x1875739267917184:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844702.548093:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788844702.548850:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267917184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788844702.548961:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.548973:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549004:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549012:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549044:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844702.549052:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549059:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549066:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549072:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549083:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788844702.549090:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549096:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549101:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549118:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549125:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788844702.549450:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549461:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549467:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549473:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844702.549482:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788844702.549486:0:12960:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788844702.549515:0:12960:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788844702.549521:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788844702.549526:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788844702.549617:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788844702.549626:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91eeff13b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788844702.549632:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91eeff65f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788844702.549637:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff91eec4f5cd28) has exports, disconnecting them 00000020:00080000:2.0:1788844702.549652:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91eeff13b000), last request at 1788844698 00000020:00000080:2.0:1788844702.549661:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d91a1 00000100:00080000:2.0:1788844702.549680:0:12960:0:(import.c:65:import_set_state_nolock()) ffff91eefb386800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788844702.549744:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eeff13b000): rc 0 00000020:00000080:2.0:1788844702.549747:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eeff13b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788844702.549759:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91eeff65f000), last request at 1788844698 00000020:00000080:2.0:1788844702.549763:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d90d6 00000100:00080000:2.0:1788844702.549769:0:12960:0:(import.c:65:import_set_state_nolock()) ffff91eeff659800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788844702.549781:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eeff13b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788844702.549836:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eefb386800 for lustre-MDT0000 00000020:00080000:2.0:1788844702.549852:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eeff65f000): rc 0 00000020:00000080:2.0:1788844702.549854:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eeff65f000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788844702.549865:0:12960:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4edc1697ae0 00000020:00000080:2.0:1788844702.549879:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eeff65f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788844702.549905:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eeff659800 for lustre-MDT0000 00000100:00080000:2.0:1788844702.549933:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788844702.549938:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788844702.549952:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788844702.550023:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788844702.550052:0:12960:0:(import.c:65:import_set_state_nolock()) ffff91eeff13f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788844702.550071:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788844702.550074:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788844702.550082:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1788844702.550368:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788844702.550379:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550388:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed99ba200 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844702.550392:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550402:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844702.550410:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844702.550416:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788844702.550419:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788844702.550422:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788844702.550455:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550462:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788844702.550484:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550504:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eed99ba200/0x7f1093851e2d92b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d92b9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550519:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788844702.550522:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550528:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0205ca00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844702.550556:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550564:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844702.550578:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844702.550583:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788844702.550586:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788844702.550587:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788844702.550605:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550611:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788844702.550618:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550625:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0205ca00/0x7f1093851e2d91d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d91e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550660:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788844702.550665:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550670:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025a00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844702.550672:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550679:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844702.550685:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844702.550689:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788844702.550691:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788844702.550694:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788844702.550708:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550714:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788844702.550733:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550740:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0025a00/0x7f1093851e2d94db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d94e2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550749:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844702.550753:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550765:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024a00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844702.550769:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550775:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844702.550781:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844702.550786:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788844702.550789:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788844702.550791:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788844702.550805:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550812:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788844702.550818:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550825:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2d8f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d8f94 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.550835:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844702.550837:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844702.550839:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844702.550859:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267917440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788844702.550941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844702.551001:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844702.551015:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267917568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788844702.551041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844702.551256:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267917696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788844702.551286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844702.551304:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788844702.551310:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267917824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788844702.551328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844702.551356:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267917440 00000100:00100000:0.0:1788844702.551364:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267917440 00000100:00100000:0.0:1788844702.551411:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267917568 00000100:00100000:0.0:1788844702.551414:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267917568 00000100:00100000:0.0:1788844702.551427:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267917696 00000100:00100000:0.0:1788844702.551429:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267917696 00000100:00100000:0.0:1788844702.551440:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267917824 00000100:00100000:0.0:1788844702.551443:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267917824 00000100:00100000:0.0:1788844702.551462:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788844702.551471:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb06b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+21:3307:x1875739267917440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844702.551487:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844702.551506:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ef0205ce00/0x7f1093851e2d92b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d92b2 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.551521:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788844702.551636:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788844702.551754:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788844702.551775:0:12960:0:(import.c:65:import_set_state_nolock()) ffff91eec71b0800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788844702.551817:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff91eec4f5cd28) has no exports 00000100:00100000:0.0:1788844702.551929:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb06b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+20:3307:x1875739267917440:12345-0@lo:103:ldlm_bl.0 Request processed in 457us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844702.551937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788844702.551962:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788844702.551968:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb068380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+19:3307:x1875739267917568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844702.551977:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844702.551998:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5527800/0x7f1093851e2d91e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d91d9 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.552012:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844702.552038:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb068380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+18:3307:x1875739267917568:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844702.552044:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788844702.552060:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788844702.552066:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+17:3305:x1875739267917696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844702.552075:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844702.552085:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0024600/0x7f1093851e2d94e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d94db expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.552094:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844702.552121:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+16:3305:x1875739267917696:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844702.552127:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788844702.552486:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267917312:0@lo:9:umount.0 00000100:00100000:3.0:1788844702.552947:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844702.552989:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267917952:0@lo:9:umount.0 00000100:00100000:1.0:1788844702.552990:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267917312 00000100:00100000:1.0:1788844702.553001:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267917312 00000100:00100000:1.0:1788844702.553063:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788844702.553072:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef0170b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875739267917312:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788844702.553105:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9123 00000100:00080000:1.0:1788844702.553115:0:6687:0:(import.c:65:import_set_state_nolock()) ffff91eef930e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788844702.553173:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788844702.553340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844702.553382:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267917952 00000100:00100000:1.0:1788844702.553659:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef0170b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1875739267917312:12345-0@lo:9:umount.0 Request processed in 587us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844702.553666:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788844702.553826:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267917952 00000100:00100000:3.0:1788844702.553870:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788844702.553877:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267917568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788844702.553878:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875739267917952:12345-0@lo:9:umount.0 00000100:00100000:2.0:1788844702.553891:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267917440:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788844702.553897:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9218 00000100:00080000:3.0:1788844702.553904:0:6688:0:(import.c:65:import_set_state_nolock()) ffff91eec71b6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788844702.553950:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788844702.554106:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788844702.554117:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb069500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+15:3305:x1875739267917824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844702.554252:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844702.554276:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ef0205c600/0x7f1093851e2d8f94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d8f8d expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844702.554299:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844702.554338:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb069500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed+14:3305:x1875739267917824:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (3007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844702.554345:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788844702.554473:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844702.554485:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788844702.554495:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844702.554519:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267917824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788844702.554894:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3304:x1875739267917952:12345-0@lo:9:umount.0 Request processed in 1015us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844702.554903:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:3.0:1788844702.554929:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844702.555020:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267917696:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788844702.556156:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eeff13f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788844702.556179:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788844702.556182:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788844702.556187:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267917312:0@lo:9:umount.0 00000100:00080000:3.0:1788844702.556207:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec71b0800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788844702.556227:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788844702.556229:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788844702.556231:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267917952:0@lo:9:umount.0 00000020:00080000:2.0:1788844702.568405:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff91eec4f5cd28) has no exports 00000020:00000080:2.0:1788844702.642968:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d8fe8 00000020:00000080:2.0:1788844702.643848:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eec57c1800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788844702.643883:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788844702.645856:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec57c1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788844702.646152:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788844702.646167:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788844702.646174:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff91ef01bf19b8) has no exports 00000020:00000080:3.0:1788844702.647276:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d8fe1 00000020:00000080:3.0:1788844702.647291:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eec6b31800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788844702.647370:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788844702.647381:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788844702.647384:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eec6b33000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788844702.647387:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec6b33000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788844702.647399:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788844702.648017:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec6b31800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788844702.648124:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91ef019bd780 - data ffff91eee5bf8bd0/ffff91eeff652400 00000020:01000000:3.0:1788844702.648397:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eed13f1120 - data ffff91eee5297e58/ffff91ef013e4c00 00000001:00000004:3.0:1788844702.661845:0:12960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1788844702.766167:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788844702.766180:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788844702.766216:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788844702.766236:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788844702.767673:0:7024:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788844702.767682:0:7024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788844702.767892:0:7024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788844702.774119:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788844702.774141:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788844702.774167:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788844702.774170:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788844702.775001:0:8087:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788844702.775009:0:8087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788844702.775021:0:8087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788844702.858079:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d8fb0 00000020:00000080:1.0:1788844702.858098:0:12960:0:(genops.c:885:class_export_put()) final put ffff91ef01be7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788844702.864087:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d8fc5 00000020:00000080:1.0:1788844702.864110:0:12960:0:(genops.c:885:class_export_put()) final put ffff91ef01be6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788844702.864778:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ef01be7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788844702.865041:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788844702.865054:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788844702.865066:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788844702.865071:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff91eec4f5b370) has no exports 00000004:01000000:1.0:1788844702.865296:0:12960:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788844702.866781:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9203 00000020:00000080:1.0:1788844702.866796:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eec71b3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788844702.866807:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788844702.866815:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788844702.866828:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788844702.866832:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff91eef910cd28) has no exports 00000020:00000080:1.0:1788844702.866843:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d91fc 00000020:00000080:1.0:1788844702.866847:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eec71b2000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788844702.867613:0:12960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788844702.867620:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788844702.867626:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788844702.867646:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788844702.867649:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788844702.867694:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788844702.867705:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788844702.867712:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d911c 00000020:00000080:1.0:1788844702.867718:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eef930c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788844702.867729:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788844702.867734:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788844702.867738:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788844702.867740:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff91eeff3e8000) has no exports 00000020:00000080:1.0:1788844702.867746:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9115 00000020:00000080:1.0:1788844702.867749:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eeff65e800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788844702.868141:0:12960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788844702.868144:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788844702.868147:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788844702.868150:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788844702.868152:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788844702.868183:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788844702.868188:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788844702.868240:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788844702.868244:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788844702.868295:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d8fcc 00000020:00000080:1.0:1788844702.868301:0:12960:0:(genops.c:885:class_export_put()) final put ffff91ef01be5800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788844702.868306:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788844702.868310:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788844702.868313:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788844702.868315:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff91ef01bf0000) has no exports 00000020:00000080:1.0:1788844702.868334:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788844702.868752:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ef01be6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788844702.868760:0:36:0:(genops.c:885:class_export_put()) final put ffff91eef2df9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788844702.868763:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eef2df9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788844702.868770:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788844702.868944:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec71b3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788844702.868949:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec71b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788844702.868955:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec71b0800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788844702.868959:0:36:0:(genops.c:885:class_export_put()) final put ffff91eef3164000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788844702.868961:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eef3164000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788844702.868965:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788844702.868994:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eef930c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788844702.869011:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eeff65e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788844702.869015:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eeff13f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788844702.869019:0:36:0:(genops.c:885:class_export_put()) final put ffff91eeff659000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788844702.869022:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eeff659000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788844702.869025:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788844702.869099:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ef01be5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788844702.870690:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788844702.870697:0:12960:0:(genops.c:885:class_export_put()) final put ffff91ef01be2000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788844702.870701:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff91ef01be2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788844702.870711:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788844702.870948:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d8fd3 00000020:00000080:1.0:1788844702.870957:0:12960:0:(genops.c:885:class_export_put()) final put ffff91ef01be1000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788844702.871086:0:12960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eed0c68800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788844702.871091:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eed0c68800 3 00000020:01000004:1.0:1788844702.871094:0:12960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91eed0c68800 from lustre-MDT0000 00000020:00000080:1.0:1788844702.871137:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788844702.871142:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788844702.871146:0:12960:0:(genops.c:885:class_export_put()) final put ffff91ef01be6000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788844702.871148:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff91ef01be6000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788844702.871158:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788844702.871185:0:12960:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788844702.871189:0:12960:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788844702.871194:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788844702.871199:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788844702.871204:0:12960:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788844702.871224:0:12960:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff91eec58db800 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788844702.871231:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff91eec4f58000) has exports, disconnecting them 00000020:00080000:1.0:1788844702.871236:0:12960:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff91eec58db800), last request at 1788844437 00000020:00000080:1.0:1788844702.871254:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d8f71 00000020:00010000:1.0:1788844702.871259:0:12960:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91eec58db800: total 1 00000100:00080000:1.0:1788844702.871264:0:12960:0:(import.c:65:import_set_state_nolock()) ffff91eec58db000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788844702.871340:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eec58db800): rc 0 00000020:00080000:1.0:1788844702.871345:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff91eec4f58000) has no exports 00000100:00100000:1.0:1788844702.872661:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff91eed83cea00:5833] 1 exiting: rc = 0 00000100:00100000:1.0:1788844702.872799:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff91eed1df6800:5834] 2 exiting: rc = 0 00000100:00100000:2.0:1788844702.874053:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff91eed841aa00:5831] 0 exiting: rc = 1 00000020:00000080:0.0:1788844702.874442:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ef01be1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788844702.874487:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874504:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874512:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874520:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874528:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874568:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874578:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874586:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874595:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874603:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874610:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874617:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874623:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874629:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874646:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874653:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874659:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874665:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874671:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874676:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874682:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874689:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874697:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874703:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874709:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874716:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874723:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874731:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874738:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874744:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874750:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874756:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874783:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874789:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874796:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874806:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874813:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874819:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874825:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874831:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874837:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874843:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874848:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874855:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874862:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874868:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874875:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874881:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874887:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874894:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874899:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874905:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874910:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874917:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874923:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874929:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874935:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874941:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874947:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874954:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874960:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874968:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874975:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844702.874981:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:3.0:1788844702.875407:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91eec58db800: total 0 00010000:00010000:3.0:1788844702.875473:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91eec58db800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788844702.875663:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ef0205c400/0x7f1093851e2d928f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d9288 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844702.875745:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ef0205c000/0x7f1093851e2d9281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d927a expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844702.875763:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ef0205dc00/0x7f1093851e2d929d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d9296 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844702.875779:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bb400/0x7f1093851e2d94d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d94cd expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844702.875791:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526a00/0x7f1093851e2d9089 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d9082 expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844702.875808:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5526800/0x7f1093851e2d92c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d92c0 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844702.875819:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bbe00/0x7f1093851e2d94c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d94bf expref: 3 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844702.875830:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed99bb000/0x7f1093851e2d9273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7f1093851e2d926c expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844702.875840:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91eec58db800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788844702.875866:0:5828:0:(genops.c:885:class_export_put()) final put ffff91eec58db800/528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed 00010000:00010000:3.0:1788844702.875886:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844702.875888:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844702.875890:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788844702.875912:0:12960:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788844702.875915:0:12960:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1788844702.875933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec58db800/528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed for MGS 00000020:00000080:1.0:1788844702.876043:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec58db000 for MGS 00000020:01000000:3.0:1788844702.877833:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eeff68d540 - data ffff91eeffcdeca8/ffff91eefb058c00 00000020:01000000:3.0:1788844702.877979:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eed22ef180 - data ffff91eee5beb5e8/ffff91eec785ac00 00000020:00000080:3.0:1788844702.879204:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d8f55 00000020:00000080:3.0:1788844702.879292:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eed1e76800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788844702.879353:0:12960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eed0c68800 from MGS, refs=2 00000020:01000004:3.0:1788844702.879357:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eed0c68800 2 00000020:01000004:3.0:1788844702.879361:0:12960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91eed0c68800 from MGS 00000020:00000080:3.0:1788844702.879400:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788844702.879409:0:12960:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788844702.879412:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eed1e77000/MGS 00000020:00000080:3.0:1788844702.879415:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff91eed1e77000/MGS for MGS 00000020:01000000:3.0:1788844702.879425:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788844702.879532:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788844702.879566:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788844702.879573:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788844702.879582:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff91eec6b50000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788844702.879590:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff91ef01bf3370) has exports, disconnecting them 00000020:00080000:3.0:1788844702.879596:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff91eec6b50000), last request at 1788844438 00000020:00000080:3.0:1788844702.879601:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9020 00000020:00080000:3.0:1788844702.879613:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eec6b50000): rc 0 00000020:00000080:3.0:1788844702.879618:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eec6b50000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788844702.879870:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eed1e76800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788844702.880009:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec6b50000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788844702.884739:0:12960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788844702.884750:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788844702.884755:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788844702.884764:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788844702.884909:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec6b50800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788844702.885226:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788844702.885237:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788844702.885244:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eec6b54800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788844702.885248:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec6b54800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788844702.885256:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788844702.885331:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eed0c68800 1 00000020:00000080:0.0:1788844702.885338:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d8f47 00000020:00000080:0.0:1788844702.885345:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eed1e71000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788844702.885358:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788844702.885362:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788844702.885367:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788844702.885371:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff91eef910b370) has no exports 00000020:00000080:3.0:1788844702.885780:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eed1e71000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788844702.910794:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788844702.990031:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788844702.990053:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788844702.990061:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eec59e5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788844702.990066:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec59e5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788844702.990081:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788844702.990253:0:12960:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91eed0c6e000 00000020:01000000:0.0:1788844702.990602:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788844702.990608:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788844702.990614:0:12960:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788844702.990620:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff91eec4f599b8) has no exports 00000100:00100000:2.0:1788844702.990804:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff91eed85ae000:5838] 0 exiting: rc = 1 00000100:00100000:0.0:1788844702.990997:0:8217:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff91eed2df7e00:8217] 3 exiting: rc = 0 00000100:00100000:3.0:1788844702.999612:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff91eed8516800:5840] 2 exiting: rc = 0 00000100:00100000:3.0:1788844702.999785:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff91eed8516e00:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1788844702.999862:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844702.999879:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844702.999962:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844702.999968:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844702.999974:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844702.999980:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844702.999987:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844702.999994:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000000:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000007:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000013:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000019:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000024:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000030:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000036:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000042:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000048:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000054:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000060:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000067:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000073:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000079:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000085:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000091:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000098:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000105:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000111:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000118:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000125:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000131:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000137:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000144:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000150:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000157:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000163:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000170:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000184:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000190:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000197:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000204:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000210:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000231:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000239:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000245:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000252:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000258:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000266:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000703:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000714:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000721:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000728:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000735:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000741:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000747:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000754:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000761:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000767:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000779:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000785:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000791:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000797:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000802:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000809:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.000821:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.006702:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91eed8582e00:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1788844703.006987:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff91eed8582000:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1788844703.007057:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007067:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007073:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007080:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007086:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007092:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007100:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007106:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007112:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007118:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007136:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007142:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007149:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007155:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007160:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007166:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007171:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007177:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007182:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007187:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007192:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007197:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007203:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007208:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007213:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007219:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007265:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007275:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007281:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007287:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007292:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007298:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007304:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007310:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007316:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007340:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007349:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007367:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007373:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007378:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007383:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007388:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007393:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007398:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007402:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007407:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007411:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007416:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007421:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007426:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007430:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007435:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007440:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007444:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007449:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007457:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007461:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007466:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007471:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007475:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007480:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007485:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007490:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.007496:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.008120:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff91eed8582400:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1788844703.008433:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff91eed831aa00:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1788844703.008967:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.008981:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.008990:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.008997:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009003:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009026:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009042:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009048:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009055:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009061:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009067:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009077:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009083:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009089:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009096:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009102:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009108:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009114:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009368:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009384:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009390:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009397:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009404:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009413:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009419:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009425:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009431:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009442:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009449:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009456:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009475:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009481:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009487:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009494:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009502:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009509:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009516:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009523:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009532:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009582:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009597:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009606:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.009627:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010255:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010267:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010276:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010284:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010290:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010296:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010304:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010311:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010318:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010324:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010331:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010511:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010519:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010526:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010532:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010567:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010577:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010584:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010590:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010598:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.010605:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.057379:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91eed8583800:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1788844703.057768:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91eed8583400:5846] 1 exiting: rc = 0 00000100:00100000:1.0:1788844703.058037:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058047:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058054:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058060:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058067:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058073:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058079:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058085:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058091:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058098:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058104:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058109:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058115:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058121:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058127:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058132:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058138:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058144:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058149:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058155:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058160:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058166:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058172:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058178:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058200:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058206:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058212:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058217:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058223:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058228:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058234:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058239:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058245:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058252:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058258:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058263:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058269:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058274:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058279:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058285:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058291:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058296:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058302:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058307:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058312:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058317:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058323:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058329:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058335:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058341:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058347:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058352:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058356:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058362:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058368:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058374:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058380:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058386:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058392:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058405:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058411:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058416:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058422:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.058428:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.059733:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91eed85af800:5848] 1 exiting: rc = 0 00000100:00100000:3.0:1788844703.059841:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff91eed84b0600:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1788844703.059964:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.059971:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.059977:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.059981:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.059987:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.059993:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.059999:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060005:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060011:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060017:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060023:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060029:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060034:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060040:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060047:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060053:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060059:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060065:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060071:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060077:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060082:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060088:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060094:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060099:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060104:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060110:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060116:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060121:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060128:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060133:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060151:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060156:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060161:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060167:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060173:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060179:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060185:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060192:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060198:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060203:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060209:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060214:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060219:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060224:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060229:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060234:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060240:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060246:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060252:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060257:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060263:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060269:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060274:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060280:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060286:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060291:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060297:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060302:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060308:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060312:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060317:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060322:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060326:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.060332:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844703.060862:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff91eed84b0200:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1788844703.060956:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff91eef2ed1c00:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1788844703.061035:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061050:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061056:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061062:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061068:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061074:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061080:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061086:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061092:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061097:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061103:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061109:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061115:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061121:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061127:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061133:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061138:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061144:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061149:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061154:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061159:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061165:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061171:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061177:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061183:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061188:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061194:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061199:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061204:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061211:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061218:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061223:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061228:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061234:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061243:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061249:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061263:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061268:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061274:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061280:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061286:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061291:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061298:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061305:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061311:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061316:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061323:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061328:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061333:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061339:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061345:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061351:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061356:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061361:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061367:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061373:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061379:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061384:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061391:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061396:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061403:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061408:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061414:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.061419:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844703.062057:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff91eef2ee9c00:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1788844703.062792:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff91eef2eeac00:5853] 2 exiting: rc = 0 00000100:00100000:3.0:1788844703.063011:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff91eef2eeb600:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1788844703.063093:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063101:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063108:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063114:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063124:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063142:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063148:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063156:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063161:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063167:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063173:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063180:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063188:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063194:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063201:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063207:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063214:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063221:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063227:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063232:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063238:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063258:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063265:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063271:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063277:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063283:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063288:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063294:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063301:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063308:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063314:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063320:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063326:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063332:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063339:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063345:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063351:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063358:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063365:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063372:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063386:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063393:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063399:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063406:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063412:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063433:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063442:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063448:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063454:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063467:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063479:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063485:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063505:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063512:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063703:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063713:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063720:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063727:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063733:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063738:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063745:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063751:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063758:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844703.063764:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788844703.071265:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788844703.071284:0:12960:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788844703.071292:0:12960:0:(genops.c:885:class_export_put()) final put ffff91eed8520800/MDS_uuid 00000020:00000080:0.0:1788844703.071297:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff91eed8520800/MDS_uuid for MDS 00000020:01000000:0.0:1788844703.071311:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788844703.071709:0:12960:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:3.0:1788844703.522374:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:3.0:1788844703.522385:0:7640:0:(genops.c:885:class_export_put()) final put ffff91eec2c3c000/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 00000020:00000080:2.0:1788844703.522518:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec2c3c000/6c5b824a-0ed7-4d17-82b7-41b1d891d7f1 for lustre-OST0001 00000020:00000080:2.0:1788844703.522668:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec2c39000 for lustre-OST0001 00000001:00100000:3.0:1788844703.522748:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788844703.522764:0:7640:0:(genops.c:885:class_export_put()) final put ffff91eec5754800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788844703.522831:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec5754800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788844703.522916:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec71b6800 for lustre-OST0001 00010000:00010000:3.0:1788844703.933639:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844703.993813:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267918080:0@lo:400:kworker.0 00000400:00000100:1.0:1788844703.993872:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875739267918080 offset 0 length 224: 4 00000100:00100000:1.0:1788844703.993931:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788844703.993937:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267918208:0@lo:400:kworker.0 00000400:00000100:1.0:1788844703.993958:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875739267918208 offset 0 length 224: 4 00000100:00100000:1.0:1788844703.993983:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267918336:0@lo:400:kworker.0 00000400:00000100:1.0:1788844703.994005:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875739267918336 offset 0 length 224: 4 00010000:00010000:1.0:1788844704.954729:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844705.979713:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788844706.739200:0:13112:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788844706.761831:0:13112:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788844706.761879:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844706.761892:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844706.761899:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844706.761905:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844706.762289:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788844706.762296:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788844706.762321:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788844706.762334:0:13112:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edc12f0700 x1875739267918208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844719 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844706.762361:0:13112:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788844706.762367:0:13112:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788844706.762391:0:13112:0:(import.c:65:import_set_state_nolock()) ffff91ef01be3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788844706.762418:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267918208:0@lo:400:kworker.0 00000100:00100000:0.0:1788844706.762490:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875739267918464:0@lo:39:umount.0 00000400:00000100:0.0:1788844706.762569:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875739267918464 offset 0 length 224: 4 00010000:00010000:1.0:1788844706.762809:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844706.762816:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844706.762824:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed99bbc00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844706.762828:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844706.762836:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844706.762843:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844706.762849:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788844706.762851:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788844706.762854:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788844706.762879:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844706.762885:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788844706.762936:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788844706.763023:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844706.763057:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eed99bbc00/0x7f1093851e2d9288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7f1093851e2d928f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844706.763070:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844706.763072:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844706.763074:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844706.763478:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267918592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788844706.763530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844706.763731:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267918592 00000100:00100000:0.0:1788844706.763738:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267918592 00000100:00100000:0.0:1788844706.763786:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788844706.763792:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1875739267918592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788844706.763798:0:5826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788844706 with bad export cookie 9155980242390454129 00000100:00100000:1.0:1788844706.777997:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1875739267918592:12345-0@lo:103:ldlm_bl.0 Request processed in 14196us (14458us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788844706.778018:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788844706.778365:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788844706.778370:0:3305:0:(import.c:65:import_set_state_nolock()) ffff91eec58de800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788844706.778388:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788844706.794351:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.143@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788844706.794360:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788844706.794372:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edc12f3100 x1875739267918080/t0(0) o400->MGC192.168.204.143@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788844719 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844706.794405:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edc12f0000 x1875739267918592/t0(0) o103->MGC192.168.204.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788844722 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788844706.794484:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788844706.794489:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788844706.794490:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788844706.794495:0:3305:0:(import.c:65:import_set_state_nolock()) ffff91eec58de800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788844706.794502:0:3305:0:(import.c:510:import_select_connection()) MGC192.168.204.143@tcp: connect to NID 0@lo last attempt 152 00000100:00080000:2.0:1788844706.794515:0:3305:0:(import.c:624:import_select_connection()) MGC192.168.204.143@tcp: import ffff91eec58de800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1788844706.794650:0:3305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ef01709f80 x1875739267918720/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788844706.794690:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3304:1875739267918720:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788844706.794737:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875739267918720 offset 0 length 520: 4 00000100:00100000:3.0:1788844706.794797:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3305:1875739267918592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788844706.795130:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3307:1875739267918080:0@lo:400:kworker.0 00010000:00010000:3.0:1788844707.004760:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788844707.159842:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788844707.159852:0:6711:0:(genops.c:885:class_export_put()) final put ffff91eef930a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788844707.160182:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eef930a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788844707.160230:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eef930e000 for lustre-OST0000 00010000:00010000:3.0:1788844708.026701:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844709.050245:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788844709.115713:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788844709.115729:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788844709.116823:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267918848:0@lo:400:kworker.0 00000400:00000100:3.0:1788844709.116897:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875739267918848 offset 0 length 224: 4 00010000:00010000:3.0:1788844710.075461:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844711.114615:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788844712.122677:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788844712.122687:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788844712.122768:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267918976:0@lo:400:kworker.0 00000400:00000100:1.0:1788844712.122831:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875739267918976 offset 0 length 224: 4 00010000:00010000:3.0:1788844712.125649:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844713.146315:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844714.169864:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844715.194047:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844716.217831:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844716.282281:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788844706/real 1788844706] req@ffff91ef01709f80 x1875739267918720/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788844716 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844716.282318:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91ef01709f80 x1875739267918720/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788844716 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844716.282329:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788844706/real 1788844706] req@ffff91edc24ffb80 x1875739267918464/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788844716 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844716.282342:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91edc24ffb80 x1875739267918464/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788844716 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788844716.282361:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec58de800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788844716.282398:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788844716.282403:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3304:1875739267918720:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788844716.282409:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91ef01be3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788844716.282426:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875739267918464:0@lo:39:umount.0 00000100:00080000:1.0:1788844716.282587:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788844716.282592:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788844716.282596:0:37:0:(import.c:65:import_set_state_nolock()) ffff91eec58de800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788844716.282601:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.143@tcp: connect to NID 0@lo last attempt 421 00000100:00080000:1.0:1788844716.282606:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.143@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788844716.282613:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.143@tcp: import ffff91eec58de800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1788844716.282664:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc12f2d80 x1875739267919104/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788844716.282729:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788844716.282741:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267919232:0@lo:400:kworker.0 00000400:00000100:1.0:1788844716.282794:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875739267919232 offset 0 length 224: 4 00000100:00080000:2.0:1788844716.283115:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788844716.283120:0:13112:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788844716.283126:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788844716.284439:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3304:1875739267919104:0@lo:250:kworker.0 00000400:00000100:0.0:1788844716.284491:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875739267919104 offset 0 length 520: 4 00010000:00010000:2.0:1788844716.286336:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844716.286358:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844716.286366:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844716.286383:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844716.286412:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844716.286435:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844716.286443:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844716.286450:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844716.286456:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844716.286629:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788844716.286635:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788844716.286659:0:13112:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788844716.286664:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788844716.286670:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788844716.286676:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788844716.286681:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff91eeff3ecd28) has no exports 00000020:00080000:2.0:1788844716.286725:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff91eeff3ecd28) has no exports 00010000:00010000:1.0:1788844716.295636:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788844716.295653:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844716.295664:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527600 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844716.295668:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844716.295678:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844716.295685:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844716.295692:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788844716.295695:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788844716.295698:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788844716.295719:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eec58de800 00010000:00010000:1.0:1788844716.295723:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844716.295728:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec5527600/0x7f1093851e2d9296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d929d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844716.295741:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844716.295762:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844716.295768:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031000 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844716.295770:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844716.295778:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844716.295784:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844716.295788:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788844716.295791:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788844716.295793:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788844716.295800:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eec58de800 00010000:00010000:1.0:1788844716.295803:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844716.295810:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0031000/0x7f1093851e2d94cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d94d4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844716.295818:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844716.295820:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844716.295822:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844716.295930:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788844716.297805:0:13112:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eed03ac360 - data ffff91eee5350d80/ffff91eefb64d400 00000020:01000000:2.0:1788844716.297973:0:13112:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eec5718b40 - data ffff91eee5be46c0/ffff91eeff652800 00100000:10000000:2.0:1788844716.311581:0:13112:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788844716.355824:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d90a5 00000020:00000080:0.0:1788844716.355834:0:13112:0:(genops.c:885:class_export_put()) final put ffff91eec4ebc800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788844716.355851:0:13112:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eef3110000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788844716.355855:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eef3110000 2 00000020:01000004:0.0:1788844716.355858:0:13112:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91eef3110000 from lustre-OST0000 00000020:00000080:0.0:1788844716.355893:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788844716.355916:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788844716.355920:0:13112:0:(genops.c:885:class_export_put()) final put ffff91eeff13c800/lustre-OST0000_UUID 00000020:00000080:0.0:1788844716.355923:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff91eeff13c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788844716.355933:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788844716.355971:0:13112:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788844716.355975:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788844716.355979:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788844716.355984:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788844716.355991:0:13112:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91eef5c9f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788844716.355997:0:13112:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff91eed8508000) has exports, disconnecting them 00000020:00080000:0.0:1788844716.356001:0:13112:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91eef5c9f800), last request at 1788844460 00000020:00000080:0.0:1788844716.356005:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d90cf 00000020:00080000:0.0:1788844716.356014:0:13112:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91eef5c9f800): rc 0 00000020:00000080:0.0:1788844716.356019:0:13112:0:(genops.c:885:class_export_put()) final put ffff91eef5c9f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788844716.356827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec4ebc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788844716.356842:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eef5c9f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788844716.360601:0:13112:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788844716.360610:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788844716.360632:0:13112:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788844716.360639:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788844716.360810:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788844716.360819:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788844716.360827:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eef3110000 1 00000020:00000080:1.0:1788844716.360833:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d905f 00000020:00000080:1.0:1788844716.360842:0:13112:0:(genops.c:885:class_export_put()) final put ffff91eec6b52000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788844716.360847:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788844716.360852:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788844716.360856:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788844716.360860:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff91ef01bf4d28) has no exports 00000020:00000080:3.0:1788844716.360966:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ef01be3000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788844716.360974:0:37:0:(genops.c:885:class_export_put()) final put ffff91eed8525000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788844716.360977:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eed8525000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788844716.360995:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788844716.361051:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec6b52000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788844716.376161:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788844716.376177:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788844716.376183:0:13112:0:(genops.c:885:class_export_put()) final put ffff91eef2df8800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788844716.376187:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff91eef2df8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788844716.376194:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788844716.376350:0:13112:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91eef2dff800 00000020:02000400:1.0:1788844716.376425:0:13112:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788844717.241701:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844718.266522:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844719.290719:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788844719.357386:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788844703/real 1788844703] req@ffff91edc12f3480 x1875739267918336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788844719 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844719.406275:0:3305:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff91edc12f3480 x1875739267918336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788844719 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788844719.406302:0:3305:0:(import.c:65:import_set_state_nolock()) ffff91ef0166a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788844719.406307:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788844719.424004:0:3305:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1788844719.426140:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267918336:0@lo:400:kworker.0 00000100:00080000:0.0:1788844719.426639:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788844719.426647:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788844719.426650:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788844719.426653:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788844719.426659:0:36:0:(import.c:65:import_set_state_nolock()) ffff91ef0166a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788844719.426665:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 198 00000100:00080000:0.0:1788844719.426689:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91ef0166a000 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:0.0:1788844719.426733:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eefb069880 x1875739267919360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788844719.427070:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875739267919360:0@lo:38:kworker.0 00000400:00000100:2.0:1788844719.427138:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875739267919360 offset 0 length 520: 4 00000020:01000004:3.0:1788844719.540182:0:13263:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788844719.562446:0:13263:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788844719.562599:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.562619:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.562627:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.562636:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.562666:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788844719.562673:0:13263:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788844719.562702:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788844719.562717:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edc12f3100 x1875739267918848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844725 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844719.562754:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edc12f1f80 x1875739267918976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844728 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844719.562773:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edc12f1180 x1875739267919232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844732 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844719.562789:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91eefb069880 x1875739267919360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788844729 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844719.562807:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788844719.562859:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875739267918848:0@lo:400:kworker.0 00000100:00080000:3.0:1788844719.562901:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788844719.562908:0:13263:0:(import.c:65:import_set_state_nolock()) ffff91ef0166a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788844719.562914:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788844719.562919:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edc12f1f80 x1875739267918976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844728 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844719.562928:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edc12f1180 x1875739267919232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844732 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844719.562937:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91eefb069880 x1875739267919360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788844729 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844719.562945:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788844719.562948:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:0.0:1788844719.563755:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844719.563767:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844719.563794:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527200 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844719.563812:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844719.563822:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844719.563830:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844719.563836:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788844719.563839:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788844719.563842:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788844719.563860:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eec58de800 00010000:00010000:0.0:1788844719.563865:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844719.563872:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec5527200/0x7f1093851e2d926c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d9273 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844719.563887:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844719.563889:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844719.563890:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844719.563913:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875739267919232:0@lo:400:kworker.0 00000100:00100000:0.0:1788844719.564715:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267918976:0@lo:400:kworker.0 00000100:00100000:2.0:1788844719.565123:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875739267919360:0@lo:38:kworker.0 00010000:00010000:3.0:1788844719.567308:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.568883:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.568900:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.568919:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.568985:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788844719.568996:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.569004:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.569010:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.569017:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844719.572130:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788844719.572150:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844719.572165:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec13a1a00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:1.0:1788844719.572171:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844719.572183:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788844719.572192:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844719.572215:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788844719.572218:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788844719.572237:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eec58de800 00010000:00010000:1.0:1788844719.572241:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844719.572248:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec13a1a00/0x7f1093851e2d927a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d9281 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844719.572403:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844719.572410:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844719.572424:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65600 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844719.572427:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844719.572435:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844719.572442:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844719.572447:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788844719.572450:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788844719.572455:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eec58de800 00010000:00010000:0.0:1788844719.572458:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844719.572476:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844719.572478:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844719.572480:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844719.574331:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788844719.574353:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eed0d65600/0x7f1093851e2d94bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d94c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844719.574390:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788844719.574399:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788844719.574402:0:13263:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788844719.574442:0:13263:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788844719.574448:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788844719.574458:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788844719.575032:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788844719.575040:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff91eec2de99b8) has no exports 00000020:00080000:3.0:1788844719.575077:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff91eec2de99b8) has no exports 00010000:00010000:0.0:1788844719.580605:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788844719.581409:0:13263:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eeff68d420 - data ffff91eed96380d8/ffff91eefb05a800 00000020:01000000:3.0:1788844719.581683:0:13263:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91eefb3b8000 - data ffff91eeffc35ca8/ffff91eed0915400 00100000:10000000:2.0:1788844719.613292:0:13263:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788844719.712504:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d9170 00000020:00000080:3.0:1788844719.712516:0:13263:0:(genops.c:885:class_export_put()) final put ffff91eefb4e1800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788844719.712530:0:13263:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eefacdc000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788844719.712533:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eefacdc000 2 00000020:01000004:3.0:1788844719.712555:0:13263:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91eefacdc000 from lustre-OST0001 00000020:00000080:3.0:1788844719.712588:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788844719.712601:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788844719.712605:0:13263:0:(genops.c:885:class_export_put()) final put ffff91eeff65f800/lustre-OST0001_UUID 00000020:00000080:3.0:1788844719.712608:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff91eeff65f800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788844719.712617:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788844719.712774:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed->MGS 00010000:00010000:3.0:1788844719.712795:0:13263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2d9082 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d9089 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788844719.712864:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eefb4e1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:00010000:3.0:1788844719.712953:0:13263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2d9082 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d9089 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844719.712963:0:13263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788844719.712966:0:13263:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788844719.712971:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788844719.712992:0:13263:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eec58de800 00010000:00010000:3.0:1788844719.712997:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2d9082 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d9089 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844719.713019:0:13263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec13a1e00/0x7f1093851e2d92c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7f1093851e2d92c7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844719.713026:0:13263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec13a1e00/0x7f1093851e2d92c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7f1093851e2d92c7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844719.713047:0:13263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788844719.713049:0:13263:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788844719.713051:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788844719.713080:0:13263:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91eec58de800 00010000:00010000:3.0:1788844719.713083:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec13a1e00/0x7f1093851e2d92c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7f1093851e2d92c7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788844719.713109:0:13263:0:(import.c:65:import_set_state_nolock()) ffff91eec58de800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788844719.713114:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788844719.713117:0:13263:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788844719.713119:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788844719.713124:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788844719.713138:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edc12f2d80 x1875739267919104/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788844731 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788844719.713163:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788844719.713167:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1788844719.713205:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed:3304:1875739267919104:0@lo:250:kworker.0 10000000:01000000:3.0:1788844719.713290:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788844719.713299:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d8f63 00000020:00000080:3.0:1788844719.713304:0:13263:0:(genops.c:885:class_export_put()) final put ffff91eed8522000/528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed 00000020:00000080:0.0:1788844719.713431:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eed8522000/528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed for MGC192.168.204.143@tcp 00000020:01000000:3.0:1788844719.713564:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.143@tcp (flags='') 00000020:00000080:3.0:1788844719.713571:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788844719.713579:0:13263:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.143@tcp: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788844719.713584:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff91eed850cd28) has no exports 10000000:01000000:0.0:1788844719.713728:0:5836:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788844719.713927:0:13263:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.143@tcp: client import never connected 00000100:00080000:3.0:1788844719.713930:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788844719.713933:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788844719.713936:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788844719.713938:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788844719.713990:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788844719.713996:0:13263:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.143@tcp (uuid 528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed) 00000020:01000000:3.0:1788844719.714017:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788844719.714042:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91eec58de800 for MGC192.168.204.143@tcp 00000020:00000080:0.0:1788844719.714050:0:36:0:(genops.c:885:class_export_put()) final put ffff91eec58dd800/528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed 00000020:00000080:0.0:1788844719.714053:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eec58dd800/528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed for MGC192.168.204.143@tcp 00000020:01000000:0.0:1788844719.714059:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.143@tcp (528dd9f8-c5f1-42e8-8444-8ae69b6bf9ed) 00000020:00000080:3.0:1788844719.714148:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788844719.714153:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788844719.714159:0:13263:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff91ef01668800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788844719.714164:0:13263:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff91eeff3eb370) has exports, disconnecting them 00000020:00080000:3.0:1788844719.714170:0:13263:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff91ef01668800), last request at 1788844484 00000020:00000080:3.0:1788844719.714174:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d919a 00000020:00080000:3.0:1788844719.714187:0:13263:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91ef01668800): rc 0 00000020:00000080:3.0:1788844719.714191:0:13263:0:(genops.c:885:class_export_put()) final put ffff91ef01668800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788844719.714917:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ef01668800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788844719.726891:0:13263:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788844719.727039:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788844719.727045:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788844719.727053:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788844719.727126:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ef0166a000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788844719.727134:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788844719.727411:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788844719.727877:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff91eed08a1200:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1788844719.728078:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91eed08a0a00:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1788844719.728160:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.739387:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff91eed04fa400:5826] 2 exiting: rc = 0 00000100:00100000:2.0:1788844719.739687:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff91eec7374000:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1788844719.740126:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff91eed04fb000:5825] 1 exiting: rc = 0 00000100:00100000:1.0:1788844719.740212:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740222:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740230:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740239:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740246:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740253:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740260:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740267:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740274:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740282:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740289:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740295:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740303:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740321:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740342:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740348:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740355:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740360:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740365:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740372:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740378:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740384:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740389:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740395:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740400:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740407:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740413:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740419:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740425:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740431:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740437:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740443:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740448:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740454:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740460:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740478:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740484:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740489:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740495:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740500:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740507:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740513:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740519:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740525:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740530:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740556:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740564:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740570:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740576:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740590:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740596:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740602:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740608:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740614:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740619:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740625:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740631:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740637:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740642:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740648:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740653:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740659:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740665:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.740671:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788844719.745056:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788844719.745077:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788844719.745087:0:13263:0:(genops.c:885:class_export_put()) final put ffff91ef0166d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788844719.745093:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff91ef0166d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788844719.745102:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788844719.745172:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eefacdc000 1 00000020:00000080:1.0:1788844719.745187:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7f1093851e2d913f 00000020:00000080:1.0:1788844719.745195:0:13263:0:(genops.c:885:class_export_put()) final put ffff91eef5c99000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788844719.745215:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788844719.745223:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788844719.745229:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788844719.745235:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff91eeff3e99b8) has no exports 00000020:00000080:3.0:1788844719.746129:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91eef5c99000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788844719.815123:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788844719.815144:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788844719.815150:0:13263:0:(genops.c:885:class_export_put()) final put ffff91eefacde000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788844719.815156:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff91eefacde000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788844719.815169:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788844719.815433:0:13263:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91eefacd8800 00000020:01000000:1.0:1788844719.815472:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788844719.815477:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788844719.815483:0:13263:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788844719.815489:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff91eec2de8000) has no exports 00000020:00000080:1.0:1788844719.815512:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788844719.815519:0:13263:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788844719.815522:0:13263:0:(genops.c:885:class_export_put()) final put ffff91eef2df8000/OSS_uuid 00000020:00000080:1.0:1788844719.815524:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff91eef2df8000/OSS_uuid for OSS 00000020:01000000:1.0:1788844719.815529:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788844719.816199:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff91eefaccc400:6686] 0 exiting: rc = 1 00000100:00100000:1.0:1788844719.816323:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff91eef3175800:6687] 1 exiting: rc = 0 00000100:00080000:2.0:1788844719.816339:0:5835:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788844719.816490:0:7066:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff91eee0525200:7066] 3 exiting: rc = 0 00000100:00100000:2.0:1788844719.816598:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff91eefacccc00:6688] 2 exiting: rc = 0 00000100:00100000:1.0:1788844719.817972:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.817985:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.817993:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818002:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818008:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818014:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818019:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818025:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818031:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818037:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818042:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818049:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818055:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818060:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818065:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818071:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818076:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818080:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818085:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818090:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818095:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818100:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818105:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818116:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818142:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818147:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818154:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818160:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818166:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818171:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818177:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818182:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818187:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818193:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818197:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818202:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818208:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818213:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818218:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818222:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818229:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818234:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818239:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818245:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818250:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818255:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818260:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818265:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818269:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818275:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818279:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818284:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818289:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818294:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818298:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818304:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818319:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818324:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818336:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818347:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818354:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818359:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818365:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.818370:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844719.819600:0:12522:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff91eefb127a00:12522] 2 exiting: rc = 0 00000100:00100000:2.0:1788844719.819719:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91eef37bbc00:6689] 0 exiting: rc = 1 00000100:00100000:0.0:1788844719.821621:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff91eef37ba200:6690] 1 exiting: rc = 0 00000100:00100000:1.0:1788844719.824211:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824225:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824231:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824235:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824241:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824246:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824251:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824256:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824261:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824266:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824272:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824277:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824284:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824289:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824295:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.824301:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825050:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825074:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825084:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825090:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825096:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825101:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825595:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825605:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825610:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825616:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825622:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825627:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825633:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825644:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825671:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825682:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825691:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825701:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825710:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825717:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825722:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825727:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825733:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825738:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825742:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825747:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825751:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825756:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825761:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825765:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825769:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825773:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825778:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825782:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.825788:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826706:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826721:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826727:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826733:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826738:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826744:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826751:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826757:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826763:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826769:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826774:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826780:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788844719.826786:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788844719.846792:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff91eef3174c00:6692] 1 exiting: rc = 0 00000100:00100000:3.0:1788844719.846851:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff91eeefdb7000:6691] 0 exiting: rc = 1 00000100:00100000:2.0:1788844719.847236:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff91eefb591000:6693] 2 exiting: rc = 0 00000100:00100000:3.0:1788844719.848344:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848355:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848362:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848368:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848375:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848382:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848389:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848396:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848403:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848409:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848416:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848422:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848429:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848437:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848443:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848449:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848491:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848498:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848505:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848511:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848518:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848525:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848531:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.848570:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850517:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850533:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850554:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850560:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850567:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850573:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850678:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850688:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850695:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850702:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850708:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850713:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850719:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850725:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850731:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850737:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850743:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850748:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850753:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850758:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850764:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850769:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850775:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850801:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850818:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850824:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850831:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850851:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850857:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850862:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850869:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850876:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850883:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850891:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850899:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850907:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850914:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850921:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850928:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.850934:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788844719.880862:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff91eefb593200:6694] 0 exiting: rc = 1 00000100:00100000:2.0:1788844719.880962:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff91eefb592a00:6695] 1 exiting: rc = 0 00000100:00100000:0.0:1788844719.882416:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882430:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882436:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882442:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882447:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882454:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882460:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882466:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882472:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882478:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882485:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882490:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882497:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882552:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882563:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882569:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882574:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882580:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882586:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882592:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882597:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882603:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882609:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882615:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882621:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882628:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882635:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882641:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882646:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882654:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882660:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882668:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882693:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882699:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882705:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882712:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882718:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882725:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882744:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882750:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882756:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882763:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882769:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882776:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882782:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882792:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882809:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882816:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882822:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882828:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882839:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882845:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882851:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882857:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882863:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882869:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882875:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882882:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882888:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882895:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882900:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882906:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882912:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.882918:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.883867:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff91eefb592000:6697] 1 exiting: rc = 0 00000100:00100000:1.0:1788844719.884014:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91eed8b68a00:6696] 0 exiting: rc = 1 00000100:00100000:0.0:1788844719.885963:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.885976:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.885999:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886008:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886015:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886023:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886029:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886036:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886044:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886051:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886058:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886064:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886088:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886095:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886101:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886119:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886127:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886134:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886139:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886145:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886153:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886160:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886166:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886172:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886192:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886200:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886206:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886212:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886219:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886225:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886232:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886240:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886247:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886253:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886260:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886266:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886285:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886298:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886315:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.886323:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887324:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887352:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887360:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887366:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887373:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887379:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887386:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887395:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887438:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887447:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887453:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887460:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887468:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887478:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887483:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887492:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887498:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887505:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887510:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887516:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887549:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887557:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887563:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788844719.887569:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788844719.914399:0:13263:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788844745.056264:0:13879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788844755.176726:0:14340:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788844755.176732:0:14340:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788844755.176854:0:14340:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91eed0770000 00000020:01000004:2.0:1788844755.176870:0:14340:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788844755.176878:0:14340:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788844755.176892:0:14340:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff91eeff3e99b8) 00000020:00000080:2.0:1788844755.176906:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788844755.228062:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788844755.236861:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788844755.237750:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788844755.237824:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 327: rc = 0 00100000:10000000:3.0:1788844755.237966:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 327: rc = 0 00100000:10000000:3.0:1788844755.238051:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 327: rc = 0 00100000:10000000:3.0:1788844755.238127:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 327: rc = 0 00100000:10000000:3.0:1788844755.240989:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 327: rc = 0 00100000:10000000:3.0:1788844755.241157:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 327: rc = 0 00100000:10000000:3.0:1788844755.243128:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 329: rc = 0 00100000:10000000:3.0:1788844755.248779:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:3.0:1788844755.248878:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:3.0:1788844755.250750:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 495: rc = 0 00100000:10000000:3.0:1788844755.251130:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 495: rc = 0 00100000:10000000:1.0:1788844755.265798:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 495: rc = 0 00100000:10000000:1.0:1788844755.266092:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 495: rc = 0 00100000:10000000:1.0:1788844755.266774:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 495: rc = 0 00100000:10000000:1.0:1788844755.267025:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 495: rc = 0 00100000:10000000:1.0:1788844755.268934:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 495: rc = 0 00100000:10000000:1.0:1788844755.276639:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 495: rc = 0 00100000:10000000:1.0:1788844755.280816:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 495: rc = 0 00100000:10000000:1.0:1788844755.281140:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 495: rc = 0 00100000:10000000:1.0:1788844755.283702:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 495: rc = 0 00100000:10000000:1.0:1788844755.283983:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 495: rc = 0 00100000:10000000:1.0:1788844755.284418:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 506: rc = 0 00100000:10000000:1.0:1788844755.284703:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 506: rc = 0 00100000:10000000:1.0:1788844755.284943:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 506: rc = 0 00100000:10000000:1.0:1788844755.285200:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 506: rc = 0 00100000:10000000:1.0:1788844755.286725:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 506: rc = 0 00100000:10000000:1.0:1788844755.287011:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 506: rc = 0 00100000:10000000:1.0:1788844755.288661:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 506: rc = 0 00100000:10000000:2.0:1788844755.291953:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 506: rc = 0 00100000:10000000:2.0:1788844755.292399:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 506: rc = 0 00100000:10000000:2.0:1788844755.292805:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 506: rc = 0 00100000:10000000:2.0:1788844755.293043:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 506: rc = 0 00100000:10000000:2.0:1788844755.295883:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 506: rc = 0 00100000:10000000:2.0:1788844755.296167:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 506: rc = 0 00100000:10000000:2.0:1788844755.297935:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 506: rc = 0 00100000:10000000:2.0:1788844755.301120:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 506: rc = 0 00100000:10000000:2.0:1788844755.301602:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 506: rc = 0 00100000:10000000:2.0:1788844755.301859:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 506: rc = 0 00100000:10000000:2.0:1788844755.302116:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 506: rc = 0 00100000:10000000:2.0:1788844755.302344:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 506: rc = 0 00100000:10000000:2.0:1788844755.302628:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 506: rc = 0 00100000:10000000:2.0:1788844755.302870:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 506: rc = 0 00100000:10000000:2.0:1788844755.303105:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 506: rc = 0 00100000:10000000:2.0:1788844755.303345:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 506: rc = 0 00100000:10000000:2.0:1788844755.303629:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 506: rc = 0 00100000:10000000:2.0:1788844755.303863:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 506: rc = 0 00100000:10000000:2.0:1788844755.309038:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 506: rc = 0 00100000:10000000:2.0:1788844755.309360:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 506: rc = 0 00100000:10000000:2.0:1788844755.309809:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 506: rc = 0 00100000:10000000:2.0:1788844755.310054:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 506: rc = 0 00100000:10000000:2.0:1788844755.312841:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 506: rc = 0 00100000:10000000:2.0:1788844755.313131:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 506: rc = 0 00100000:10000000:2.0:1788844755.315967:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 506: rc = 0 00100000:10000000:2.0:1788844755.317747:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 375: rc = 0 00100000:10000000:2.0:1788844755.320760:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788844755.320952:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:2.0:1788844755.321166:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788844755.322743:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:2.0:1788844755.322961:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788844755.323018:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:2.0:1788844755.325853:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788844755.325949:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:2.0:1788844755.328918:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788844755.329036:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:2.0:1788844755.332817:0:14340:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788844755.332922:0:14340:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00000020:00000080:2.0:1788844755.333198:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788844755.333212:0:14340:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788844755.333221:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2da26b 00000020:01000004:2.0:1788844755.333229:0:14340:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788844755.333234:0:14340:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788844755.333238:0:14340:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91eed0770000 from MGS 00000020:01000004:2.0:1788844755.333242:0:14340:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788844755.333252:0:14340:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff91eeff3eb370) 00000020:00000080:2.0:1788844755.333261:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788844755.333311:0:14340:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eed0770000 from MGS, refs=2 00080000:01000000:2.0:1788844755.333315:0:14340:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788844755.333320:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2da279 00000100:00100000:2.0:1788844755.333413:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788844755.336688:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788844755.336699:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788844755.339899:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788844755.339911:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788844755.341948:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788844755.342168:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788844755.342173:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788844755.343066:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788844755.343075:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788844755.343525:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788844755.343531:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788844755.348118:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844755.348125:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844755.348128:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844755.348472:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844755.348474:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844755.348476:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844755.349159:0:14340:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788844755.351937:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788844755.388390:0:14340:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788844755.388430:0:14340:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788844755.388432:0:14340:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788844755.402580:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788844755.402828:0:14340:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788844755.402948:0:14340:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788844755.406387:0:14340:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788844755.408388:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788844755.410530:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788844755.411287:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788844755.429781:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788844755.429800:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788844755.439763:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788844755.439776:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788844755.440569:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788844755.440592:0:14340:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.143@tcp' 00000020:01000004:3.0:1788844755.440594:0:14340:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788844755.440638:0:14340:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.143@tcp (typ=mgc) 00000020:00000080:3.0:1788844755.440650:0:14340:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.143@tcp (ffff91eec2de99b8) 00000020:00000080:3.0:1788844755.440665:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788844755.440737:0:14340:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eec2c38800@MGC192.168.204.143@tcp: add connection 192.168.204.143@tcp at head 00010000:00010000:3.0:1788844755.440894:0:14340:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.143@tcp-0 is initialized 00000040:01000000:3.0:1788844755.440901:0:14340:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788844755.441172:0:14354:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788844755.443161:0:14355:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788844755.443243:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.143@tcp (uuid 661a174e-3914-46cb-b31b-f72a0fba243b) 00000020:00000080:3.0:1788844755.443265:0:14340:0:(genops.c:1385:class_connect()) connect: client 661a174e-3914-46cb-b31b-f72a0fba243b, cookie 0x7f1093851e2da287 00000100:00080000:3.0:1788844755.443279:0:14340:0:(import.c:510:import_select_connection()) MGC192.168.204.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788844755.443285:0:14340:0:(import.c:624:import_select_connection()) MGC192.168.204.143@tcp: import ffff91eec2c38800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1788844755.443319:0:14340:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ef0170ad80 x1875739267919488/t0(0) o250->MGC192.168.204.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788844755.443350:0:14340:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 661a174e-3914-46cb-b31b-f72a0fba243b->MGS 00000020:01000004:3.0:1788844755.443376:0:14340:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788844755.443381:0:14340:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788844755.443395:0:14340:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff91eec2deb370) 00000020:00000080:3.0:1788844755.443406:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788844755.443560:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:661a174e-3914-46cb-b31b-f72a0fba243b:3304:1875739267919488:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788844755.443635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844755.461584:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267919488 00000100:00100000:2.0:1788844755.461599:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267919488 00000100:00100000:2.0:1788844755.461654:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788844755.461662:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1875739267919488:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788844755.461689:0:14350:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 661a174e-3914-46cb-b31b-f72a0fba243b@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:2.0:1788844755.461725:0:14350:0:(genops.c:1385:class_connect()) connect: client 661a174e-3914-46cb-b31b-f72a0fba243b, cookie 0x7f1093851e2da295 00000100:00080000:2.0:1788844755.461862:0:14350:0:(import.c:65:import_set_state_nolock()) ffff91eeff13f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788844755.461945:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+5:3304:x1875739267919488:12345-0@lo:250:mount.lustre.0 Request processed in 282us (18308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844755.461952:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788844755.462000:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788844755.462009:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.143@tcp: connect to target with instance 0 00000100:00080000:2.0:1788844755.462017:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788844755.462021:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788844755.462031:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec2c38800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788844755.462033:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788844755.462044:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788844755.462049:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:661a174e-3914-46cb-b31b-f72a0fba243b:3304:1875739267919488:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788844755.468071:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788844755.468398:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788844755.468404:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788844755.473064:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788844755.473076:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788844755.476048:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788844755.476060:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788844755.477027:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788844755.477233:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788844755.477239:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788844755.480007:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788844755.480019:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788844755.518173:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788844755.518390:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788844755.518402:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788844755.519436:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788844755.519511:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788844755.520107:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788844755.520295:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788844755.520300:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788844755.520804:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788844755.520810:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788844755.521246:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788844755.521408:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788844755.521414:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788844755.521964:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788844755.521970:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788844755.522825:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788844755.522981:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788844755.522985:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788844755.523368:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788844755.523374:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788844755.548853:0:14340:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788844755.549290:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788844755.549297:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788844755.551081:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788844755.551096:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788844755.552291:0:14340:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788844755.552300:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788844755.553381:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788844755.553405:0:14340:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788844755.553411:0:14340:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788844755.553690:0:14340:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788844755.553731:0:14340:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.143@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788844755.553736:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788844755.553737:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788844755.553739:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844755.553740:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844755.553741:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844755.553743:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844755.553744:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788844755.553745:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788844755.553747:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844755.553748:0:14340:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788844755.553751:0:14340:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788844755.553753:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788844755.553754:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788844755.553755:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844755.553756:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844755.553758:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844755.553759:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844755.553759:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788844755.553761:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788844755.553762:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844755.553763:0:14340:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788844755.553787:0:14340:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788844755.553806:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267919616:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788844755.553871:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.553957:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788844755.554070:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267919616 00000100:00100000:1.0:1788844755.554077:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267919616 00000100:00100000:1.0:1788844755.554295:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788844755.554306:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+5:14340:x1875739267919616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788844755.554357:0:14353:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788844755.554361:0:14353:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788844755.554363:0:14353:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788844755.554884:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788844755.555436:0:14353:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788844755.557270:0:14375:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788844755.557278:0:14375:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788844755.557281:0:14375:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788844755.557316:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788844755.557831:0:14353:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788844755.557844:0:14353:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788844755.567448:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+5:14340:x1875739267919616:12345-0@lo:253:mount.lustre.0 Request processed in 13126us (13557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844755.567463:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788844755.567676:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267919616:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788844755.567691:0:14340:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788844755.567694:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788844755.567696:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788844755.567698:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844755.567699:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844755.567700:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844755.567701:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844755.567702:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788844755.567704:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788844755.567705:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844755.567707:0:14340:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788844755.567725:0:14340:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91eed0770000 from lustre-MDT0000 10000000:01000000:3.0:1788844755.567753:0:14340:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788844755.567756:0:14340:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788844755.567760:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91eec2de99b8 10000000:01000000:3.0:1788844755.567764:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788844755.567771:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91eec2de99b8 from 1 10000000:01000000:3.0:1788844755.567773:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788844755.567813:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.567823:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.567832:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844755.567851:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267919744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788844755.567887:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.567955:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788844755.568303:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267919744 00000100:00100000:2.0:1788844755.568311:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267919744 00000100:00100000:2.0:1788844755.568391:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788844755.568402:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+5:14340:x1875739267919744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788844755.568419:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844755.568435:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed0d65600/0x7f1093851e2da2a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da29c expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844755.568468:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d65600/0x7f1093851e2da2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da29c expref: 6 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844755.568479:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed0d65600/0x7f1093851e2da2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da29c expref: 6 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844755.568488:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65600, rc 0) 00000100:00100000:2.0:1788844755.568531:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+6:14340:x1875739267919744:12345-0@lo:101:mount.lustre.0 Request processed in 131us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844755.568588:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788844755.568670:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267919744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844755.568702:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2a3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.568711:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da2a3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844755.568766:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267919872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788844755.568794:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.569108:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844755.569348:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267919872 00000100:00100000:0.0:1788844755.569354:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267919872 00000100:00100000:0.0:1788844755.569382:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788844755.569390:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+6:14340:x1875739267919872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788844755.569641:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+6:14340:x1875739267919872:12345-0@lo:501:mount.lustre.0 Request processed in 252us (846us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788844755.569648:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788844755.569784:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267919872:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788844755.569813:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788844755.569836:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2a3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.569844:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2a3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844755.569852:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91eed0770000 10000000:01000000:3.0:1788844755.569857:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788844755.569862:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91eed0770000 10000000:01000000:3.0:1788844755.569864:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788844755.569867:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91eed0770000 from 1 10000000:01000000:3.0:1788844755.569870:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788844755.569890:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024400/0x7f1093851e2da2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.569897:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0024400/0x7f1093851e2da2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.569916:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0024400/0x7f1093851e2da2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844755.569931:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267920000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788844755.569960:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.569994:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844755.570164:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267920000 00000100:00100000:0.0:1788844755.570168:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267920000 00000100:00100000:0.0:1788844755.570202:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788844755.570209:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eee14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+6:14340:x1875739267920000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788844755.570217:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844755.570237:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0030200/0x7f1093851e2da2b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da2aa expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.570255:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0030200/0x7f1093851e2da2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da2aa expref: 7 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.570264:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0030200/0x7f1093851e2da2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da2aa expref: 7 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.570271:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030200, rc 0) 00000100:00100000:0.0:1788844755.570302:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eee14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+7:14340:x1875739267920000:12345-0@lo:101:mount.lustre.0 Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844755.570307:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788844755.570552:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267920000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844755.570564:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0024400/0x7f1093851e2da2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2b1 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.570572:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0024400/0x7f1093851e2da2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da2b1 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844755.570582:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788844755.570597:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024400/0x7f1093851e2da2aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2b1 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.570604:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0024400/0x7f1093851e2da2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2b1 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844755.570621:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788844755.570624:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788844755.570628:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91eed0770000 10000000:01000000:3.0:1788844755.570631:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788844755.570633:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788844755.570635:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788844755.570649:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2da2b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.570661:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2da2b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.570669:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2da2b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844755.570679:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267920128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788844755.570705:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.570715:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844755.570771:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267920128 00000100:00100000:0.0:1788844755.570776:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267920128 00000100:00100000:0.0:1788844755.570791:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788844755.570796:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eee14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+7:14340:x1875739267920128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788844755.570803:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844755.570811:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0030000/0x7f1093851e2da2bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da2b8 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.570825:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0030000/0x7f1093851e2da2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da2b8 expref: 8 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.570833:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0030000/0x7f1093851e2da2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da2b8 expref: 8 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.570839:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030000, rc 0) 00000100:00100000:0.0:1788844755.570876:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eee14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+8:14340:x1875739267920128:12345-0@lo:101:mount.lustre.0 Request processed in 79us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844755.570891:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788844755.570965:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267920128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844755.570986:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2da2b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2bf expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.570995:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2da2b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da2bf expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844755.571037:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267920256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788844755.571067:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.571094:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844755.571312:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267920256 00000100:00100000:0.0:1788844755.571317:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267920256 00000100:00100000:0.0:1788844755.571334:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788844755.571339:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+8:14340:x1875739267920256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788844755.571730:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+9:14340:x1875739267920256:12345-0@lo:501:mount.lustre.0 Request processed in 390us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844755.571737:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788844755.571887:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267920256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788844755.571917:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267920384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788844755.571956:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.571988:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788844755.572087:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267920384 00000100:00100000:0.0:1788844755.572092:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267920384 00000100:00100000:0.0:1788844755.572119:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788844755.572125:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+9:14340:x1875739267920384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788844755.572705:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+9:14340:x1875739267920384:12345-0@lo:503:mount.lustre.0 Request processed in 578us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844755.572713:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788844755.572944:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267920384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788844755.573421:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14376:1875739267920512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844755.573649:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844755.573713:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eee16e1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788844755.573754:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267920512 00000100:00100000:0.0:1788844755.573760:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267920512 00000100:00100000:0.0:1788844755.573820:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788844755.573827:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+9:14376:x1875739267920512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788844755.574090:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+9:14376:x1875739267920512:12345-0@lo:502:llog_process_th.0 Request processed in 263us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844755.574097:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788844755.574178:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14376:1875739267920512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788844755.574212:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844755.574223:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.574226:0:14376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788844755.574231:0:14376:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788844755.574233:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788844755.574249:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff91eed85099b8) 00000020:00000080:1.0:1788844755.574267:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788844755.574272:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788844755.574334:0:14376:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788844755.574341:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2da2cd 00000020:00000080:1.0:1788844755.574619:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788844755.574624:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844755.574631:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.574632:0:14376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788844755.574635:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844755.574638:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.574639:0:14376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788844755.574642:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788844755.574650:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff91eed850b370) 00000020:00000080:1.0:1788844755.574659:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788844755.574663:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788844755.574665:0:14376:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788844755.574668:0:14376:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788844755.574673:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788844755.574722:0:14376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eed0770000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788844755.574737:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff91eed850cd28) 00000020:00000080:1.0:1788844755.574747:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788844755.574802:0:14376:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788844755.574808:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7f1093851e2da2e2 00000020:00000080:1.0:1788844755.574890:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788844755.574897:0:14376:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788844755.574907:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7f1093851e2da2e9 00080000:01000000:1.0:1788844755.574912:0:14376:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788844755.574915:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2da2f0 00010000:00010000:0.0:1788844755.665082:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788844755.665483:0:14376:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1788844755.665765:0:14376:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788844755.666435:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff91eef910b370) 00000020:00000080:0.0:1788844755.666461:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788844755.666533:0:14376:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788844755.666561:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2da2fe 00000020:00000080:1.0:1788844755.667048:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788844755.670927:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7f1093851e2da305 00000020:00000080:1.0:1788844755.674151:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788844755.674167:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844755.674174:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.674176:0:14376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788844755.674181:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844755.674186:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.674188:0:14376:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788844755.674192:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788844755.674231:0:14376:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788844755.674246:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844755.674249:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.674251:0:14376:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788844755.674253:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788844755.674255:0:14376:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788844755.674257:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788844755.674259:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788844755.674260:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788844755.674263:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.674264:0:14376:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788844755.674267:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788844755.674270:0:14376:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788844755.674273:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.674275:0:14376:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788844755.674278:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788844755.674284:0:14376:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.143@tcp to nid 0x20000c0a8cc8f (192.168.204.143@tcp) 00000020:01000000:1.0:1788844755.674312:0:14376:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788844755.674315:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788844755.674330:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91eed8508000) 00000020:00000080:1.0:1788844755.674353:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788844755.674359:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788844755.674426:0:14376:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788844755.674432:0:14376:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788844755.674439:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2da313 00010000:00080000:1.0:1788844755.674470:0:14376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eefb385800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:1.0:1788844755.674714:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788844755.676304:0:14376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788844755.676354:0:14376:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788844755.679654:0:14376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788844755.679729:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788844755.679815:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788844755.681435:0:14380:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788844755.681441:0:14380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788844755.682386:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788844755.682402:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788844755.682435:0:14376:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788844755.682457:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7f1093851e2da31a 00000100:00080000:1.0:1788844755.682467:0:14376:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788844755.682473:0:14376:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91eefb385800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1788844755.682506:0:14376:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc12f0380 x1875739267920640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788844755.682623:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267920640:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788844755.682681:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875739267920640 offset 0 length 520: 4 00000100:00080000:1.0:1788844755.682840:0:14376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788844755.682896:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844755.682900:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.682902:0:14376:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788844755.682905:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788844755.682907:0:14376:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788844755.682909:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788844755.682911:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788844755.682912:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788844755.682915:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.682916:0:14376:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788844755.682927:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788844755.682931:0:14376:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788844755.682935:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.682937:0:14376:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788844755.682940:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788844755.682944:0:14376:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.143@tcp to nid 0x20000c0a8cc8f (192.168.204.143@tcp) 00000020:01000000:1.0:1788844755.682966:0:14376:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788844755.682969:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788844755.683063:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91eefc9c8000) 00000020:00000080:1.0:1788844755.683078:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788844755.683085:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788844755.683148:0:14376:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788844755.683154:0:14376:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788844755.683160:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7f1093851e2da328 00010000:00080000:1.0:1788844755.683188:0:14376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eec3808800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:1.0:1788844755.683384:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788844755.683595:0:14376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788844755.683629:0:14376:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788844755.685067:0:14376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788844755.685165:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788844755.685247:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788844755.688961:0:14382:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788844755.688982:0:14382:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788844755.691523:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788844755.692115:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788844755.692221:0:14376:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788844755.692244:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7f1093851e2da32f 00000100:00080000:1.0:1788844755.692257:0:14376:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788844755.692263:0:14376:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eec3808800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1788844755.692301:0:14376:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc12f0a80 x1875739267920768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788844755.692368:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267920768:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788844755.692436:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875739267920768 offset 0 length 520: 4 00000100:00080000:1.0:1788844755.692490:0:14376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788844755.692603:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844755.692618:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.692620:0:14376:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788844755.692624:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844755.692629:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.692631:0:14376:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788844755.692633:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788844755.692635:0:14376:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788844755.692638:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844755.692640:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.692642:0:14376:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788844755.692644:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844755.692646:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.692648:0:14376:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788844755.692651:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788844755.692680:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14376:1875739267920896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844755.692731:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844755.692764:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267920896 00000100:00100000:1.0:1788844755.692770:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267920896 00000100:00100000:1.0:1788844755.692803:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788844755.692811:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+9:14376:x1875739267920896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844755.693099:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+9:14376:x1875739267920896:12345-0@lo:502:llog_process_th.0 Request processed in 287us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844755.693107:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788844755.693144:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67180 going to sleep for 11 seconds 00000100:00100000:1.0:1788844755.693163:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14376:1875739267920896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788844755.693186:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844755.693191:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.693192:0:14376:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788844755.693196:0:14376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788844755.693741:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788844755.693767:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788844755.693788:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2da2b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2bf expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.693800:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0025c00/0x7f1093851e2da2b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2bf expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844755.693808:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eed0770000 from 1 10000000:01000000:3.0:1788844755.693811:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788844755.693845:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.693853:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.693862:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844755.693877:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921024:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788844755.693907:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.693920:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788844755.695745:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267921024 00000100:00100000:0.0:1788844755.695761:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267921024 00000100:00100000:0.0:1788844755.695813:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788844755.695836:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+9:14340:x1875739267921024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788844755.695850:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844755.695868:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0030c00/0x7f1093851e2da33d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da336 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.695895:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0030c00/0x7f1093851e2da33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da336 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.695906:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0030c00/0x7f1093851e2da33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da336 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.695915:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030c00, rc 0) 00000100:00100000:0.0:1788844755.696065:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+10:14340:x1875739267921024:12345-0@lo:101:mount.lustre.0 Request processed in 243us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844755.696073:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788844755.696787:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844755.696806:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.696816:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844755.697458:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921152:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788844755.697519:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.697769:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788844755.701690:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267921152 00000100:00100000:1.0:1788844755.701707:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267921152 00000100:00100000:1.0:1788844755.701818:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788844755.701830:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+10:14340:x1875739267921152:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788844755.701857:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788844755.701863:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788844755.702113:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+10:14340:x1875739267921152:12345-0@lo:256:mount.lustre.0 Request processed in 284us (4593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844755.702121:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788844755.702200:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921152:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788844755.702816:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788844755.702848:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844755.702861:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844755.702870:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eed0770000 from 1 10000000:01000000:2.0:1788844755.702874:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788844755.702909:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844755.702918:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844755.702927:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844755.702947:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788844755.703268:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844755.703299:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eefb1376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844755.704880:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267921280 00000100:00100000:1.0:1788844755.704896:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267921280 00000100:00100000:1.0:1788844755.704949:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788844755.704960:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+10:14340:x1875739267921280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788844755.704988:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844755.705016:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed0d60600/0x7f1093851e2da34b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da344 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844755.705046:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d60600/0x7f1093851e2da34b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da344 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844755.705058:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed0d60600/0x7f1093851e2da34b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da344 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844755.705068:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60600, rc 0) 00000100:00100000:1.0:1788844755.705144:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+11:14340:x1875739267921280:12345-0@lo:101:mount.lustre.0 Request processed in 186us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844755.705151:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788844755.705240:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788844755.705257:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844755.705266:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844755.705348:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788844755.705383:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844755.705420:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eefb1376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844755.709325:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267921408 00000100:00100000:3.0:1788844755.709344:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267921408 00000100:00100000:3.0:1788844755.709391:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788844755.709400:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+11:14340:x1875739267921408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788844755.709881:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+11:14340:x1875739267921408:12345-0@lo:501:mount.lustre.0 Request processed in 481us (4496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844755.709890:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788844755.710155:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788844755.710209:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788844755.710259:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844755.710293:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eefb1376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844755.710685:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267921536 00000100:00100000:1.0:1788844755.710691:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267921536 00000100:00100000:1.0:1788844755.710725:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788844755.710732:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+11:14340:x1875739267921536:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788844755.710895:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+11:14340:x1875739267921536:12345-0@lo:503:mount.lustre.0 Request processed in 163us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844755.710902:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788844755.711116:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788844755.711942:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14384:1875739267921664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844755.712003:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844755.712039:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67540 going to sleep for 11 seconds 00000100:00100000:2.0:1788844755.712140:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267921664 00000100:00100000:2.0:1788844755.712145:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267921664 00000100:00100000:2.0:1788844755.712180:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788844755.712187:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+11:14384:x1875739267921664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844755.712411:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+11:14384:x1875739267921664:12345-0@lo:502:llog_process_th.0 Request processed in 224us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844755.712419:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788844755.713746:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14384:1875739267921664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788844755.713786:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844755.713796:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.713799:0:14384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788844755.713806:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eed0770000 00000020:00000080:1.0:1788844755.713809:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788844755.713817:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844755.713820:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.713821:0:14384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788844755.713824:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844755.713826:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.713827:0:14384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788844755.713830:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eed0770000 00000020:00000080:1.0:1788844755.713832:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788844755.713883:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844755.713886:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.713887:0:14384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788844755.713890:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844755.713892:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.713893:0:14384:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788844755.713897:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91eed0770000 00000020:00000080:1.0:1788844755.713899:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788844755.713953:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14384:1875739267921792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788844755.714018:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844755.714056:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2c67540 going to sleep for 11 seconds 00000100:00100000:3.0:1788844755.715084:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267921792 00000100:00100000:3.0:1788844755.715092:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267921792 00000100:00100000:3.0:1788844755.715137:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788844755.715145:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+11:14384:x1875739267921792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844755.715352:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+11:14384:x1875739267921792:12345-0@lo:502:llog_process_th.0 Request processed in 207us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844755.715360:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788844755.716117:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14384:1875739267921792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788844755.716150:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844755.716158:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844755.716160:0:14384:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788844755.716164:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788844755.716396:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788844755.716420:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788844755.716438:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.716449:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844755.716488:0:14340:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788844755.716491:0:14340:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91eed0770000 10000000:01000000:3.0:1788844755.716494:0:14340:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91eed0770000 10000000:01000000:3.0:1788844755.716497:0:14340:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788844755.716508:0:14340:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eed0770000 from 1 10000000:01000000:3.0:1788844755.716510:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788844755.716558:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2da352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.716567:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2da352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.717675:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2da352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844755.717700:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788844755.717751:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.718710:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4f696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844755.728941:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267921920 00000100:00100000:0.0:1788844755.728956:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267921920 00000100:00100000:0.0:1788844755.729019:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788844755.729028:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+11:14340:x1875739267921920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788844755.729053:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844755.729071:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0031e00/0x7f1093851e2da359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da352 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.729099:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0031e00/0x7f1093851e2da359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da352 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.729111:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0031e00/0x7f1093851e2da359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da352 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.729121:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031e00, rc 0) 00000100:00100000:0.0:1788844755.729195:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+12:14340:x1875739267921920:12345-0@lo:101:mount.lustre.0 Request processed in 168us (11443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844755.729202:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788844755.731130:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267921920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844755.731156:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2da352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da359 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.731167:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2da352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da359 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844755.731238:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267922048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788844755.731288:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.731365:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4f696c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844755.739766:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267922048 00000100:00100000:1.0:1788844755.739781:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267922048 00000100:00100000:1.0:1788844755.739837:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788844755.739846:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+12:14340:x1875739267922048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788844755.740149:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+12:14340:x1875739267922048:12345-0@lo:501:mount.lustre.0 Request processed in 303us (8859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844755.740157:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788844755.742231:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267922048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788844755.742291:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267922176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788844755.742349:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.742388:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4f696c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844755.742472:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267922176 00000100:00100000:3.0:1788844755.742478:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267922176 00000100:00100000:3.0:1788844755.742525:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788844755.742533:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+12:14340:x1875739267922176:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788844755.742737:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+12:14340:x1875739267922176:12345-0@lo:503:mount.lustre.0 Request processed in 204us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844755.742745:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788844755.742791:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267922176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788844755.752415:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14389:1875739267922304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844755.752499:0:14389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844755.752571:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed54fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1788844755.752637:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267922304 00000100:00100000:3.0:1788844755.752644:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267922304 00000100:00100000:3.0:1788844755.752691:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788844755.752700:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+12:14389:x1875739267922304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788844755.752924:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+12:14389:x1875739267922304:12345-0@lo:502:llog_process_th.0 Request processed in 224us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844755.752932:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788844755.753095:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14389:1875739267922304:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788844755.753160:0:14389:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788844755.753175:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91eeff3ecd28) 00000020:00000080:2.0:1788844755.753193:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788844755.753262:0:14389:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eed0770000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788844755.753272:0:14389:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eed0770000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788844755.753274:0:14389:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eed0770000 4 00010000:00080000:2.0:1788844755.753312:0:14389:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eec57c4800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.143@tcp at head 00010000:00010000:2.0:1788844755.755907:0:14389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788844755.756314:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788844755.756353:0:14389:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788844755.756366:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7f1093851e2da367 00000100:00080000:2.0:1788844755.756375:0:14389:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788844755.756381:0:14389:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91eec57c4800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:2.0:1788844755.756414:0:14389:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc24fea00 x1875739267922432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788844755.756689:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875739267922432:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788844755.756754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844755.756820:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267922432 00000100:00100000:2.0:1788844755.756826:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267922432 00000100:00100000:2.0:1788844755.756856:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788844755.756864:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875739267922432:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788844755.756911:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875739267922432:12345-0@lo:38:llog_process_th.0 Request processed in 47us (157us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788844755.756918:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788844755.756951:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788844755.756958:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec57c4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788844755.757930:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788844755.757937:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875739267922432:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788844755.757962:0:14389:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788844755.760155:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788844755.760165:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788844755.760167:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788844755.760171:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788844755.761345:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14389:1875739267922560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844755.761435:0:14389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844755.762106:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267922560 00000100:00100000:2.0:1788844755.762113:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267922560 00000100:00100000:2.0:1788844755.762154:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788844755.762161:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+12:14389:x1875739267922560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788844755.762693:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+12:14389:x1875739267922560:12345-0@lo:502:llog_process_th.0 Request processed in 529us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844755.762702:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788844755.762749:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed5554540 going to sleep for 11 seconds 00000100:00100000:2.0:1788844755.762772:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:661a174e-3914-46cb-b31b-f72a0fba243b:14389:1875739267922560:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788844755.762799:0:14389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788844755.763106:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788844755.763124:0:14340:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788844755.763147:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2da352 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da359 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.763157:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0025800/0x7f1093851e2da352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da359 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788844755.763213:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788844755.763220:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788844755.763221:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844755.763222:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844755.763223:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844755.763225:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844755.763226:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788844755.763227:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788844755.763229:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844755.763230:0:14340:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788844755.763234:0:14340:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788844755.763236:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788844755.763237:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788844755.763238:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844755.763239:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844755.763240:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844755.763241:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844755.763242:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788844755.763243:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788844755.763244:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844755.763245:0:14340:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788844755.763263:0:14340:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788844755.763276:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267922688:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788844755.763313:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844755.763329:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4f6ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788844755.765695:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267922688 00000100:00100000:2.0:1788844755.765710:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267922688 00000100:00100000:2.0:1788844755.765762:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788844755.765770:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+12:14340:x1875739267922688:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788844755.765799:0:14350:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788844755.765811:0:14350:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788844755.818629:0:14350:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788844755.818641:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788844755.818740:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788844755.818746:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788844755.818771:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.818790:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0030c00/0x7f1093851e2da33d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da336 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.818799:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.818838:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0030c00/0x7f1093851e2da33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2da336 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.818866:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eec0030c00/0x7f1093851e2da33d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2da336 expref: 12 pid: 14350 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844755.818882:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875739267922816:0@lo:104: 00000100:00100000:3.0:1788844755.818951:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844755.819069:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4f69b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788844755.820092:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267922816 00000100:00100000:2.0:1788844755.820105:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267922816 00000100:00100000:2.0:1788844755.820146:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788844755.820154:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef0170aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:661a174e-3914-46cb-b31b-f72a0fba243b+3:14374:x1875739267922816:12345-0@lo:104: 00010000:00010000:2.0:1788844755.820167:0:14341:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844755.820226:0:14341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788844755.820240:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef0170aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:661a174e-3914-46cb-b31b-f72a0fba243b+3:14374:x1875739267922816:12345-0@lo:104: Request processed in 86us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844755.820247:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788844755.820313:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875739267922816:0@lo:104: 00010000:00010000:3.0:1788844755.820333:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.821303:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844755.821313:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.821323:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024e00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844755.821328:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.821337:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844755.821345:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844755.821358:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788844755.821397:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.821404:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788844755.821424:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.821431:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0024e00/0x7f1093851e2da336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da33d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.821458:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844755.821460:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844755.821462:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844755.821482:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788844755.821493:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:661a174e-3914-46cb-b31b-f72a0fba243b:3305:1875739267922944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788844755.821549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844755.821823:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267922944 00000100:00100000:0.0:1788844755.821830:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267922944 00010000:00010000:0.0:1788844755.821848:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0030c00/0x7f1093851e2da33d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da336 expref: 13 pid: 14350 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844755.821875:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844755.821881:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:661a174e-3914-46cb-b31b-f72a0fba243b+13:3305:x1875739267922944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788844755.821892:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844755.821897:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0030c00/0x7f1093851e2da33d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da336 expref: 13 pid: 14350 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.821907:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0030c00/0x7f1093851e2da33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2da336 expref: 13 pid: 14350 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.821927:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0030c00/0x7f1093851e2da33d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2da336 expref: 13 pid: 14350 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.821940:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.821948:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788844755.821962:0:14343:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003217098s 00010000:00010000:0.0:1788844755.821966:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.822068:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.822076:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.822082:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.822087:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844755.822091:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.822106:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844755.825566:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+12:14340:x1875739267922688:12345-0@lo:253:mount.lustre.0 Request processed in 59764us (62219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844755.825715:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788844755.825815:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:14340:1875739267922688:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788844755.825831:0:14340:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788844755.825834:0:14340:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788844755.825836:0:14340:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788844755.825837:0:14340:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788844755.825839:0:14340:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788844755.825840:0:14340:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788844755.825841:0:14340:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788844755.825842:0:14340:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788844755.825844:0:14340:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788844755.825845:0:14340:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788844755.825847:0:14340:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788844755.825863:0:14340:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788844755.830759:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844755.830781:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.831110:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.831139:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0025600/0x7f1093851e2da36e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844755.831165:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844755.831258:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:661a174e-3914-46cb-b31b-f72a0fba243b+11:3305:x1875739267922944:12345-0@lo:103:ldlm_bl.0 Request processed in 9372us (9717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844755.831268:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788844755.831412:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:661a174e-3914-46cb-b31b-f72a0fba243b:3305:1875739267922944:0@lo:103:ldlm_bl.0 00080000:10000000:2.0:1788844755.833209:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788844755.833375:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788844755.833951:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788844755.834257:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788844755.834786:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788844755.834946:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788844755.836211:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788844755.836373:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788844755.836897:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788844755.840044:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788844755.840872:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788844755.841261:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788844755.878171:0:14340:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788844755.878722:0:14340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788844755.879118:0:14398:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788844755.879128:0:14398:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788844755.879402:0:14399:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788844755.880660:0:14399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788844755.884797:0:14340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788844755.884915:0:14340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788844755.887167:0:14340:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788844755.887255:0:14340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788844755.887524:0:14399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:0.0:1788844755.887736:0:14340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788844755.888081:0:14399:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788844755.888086:0:14399:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788844755.889871:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788844755.890829:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788844755.890882:0:14340:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788844755.893931:0:14340:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788844755.903429:0:14340:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788844755.950335:0:14340:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788844755.950373:0:14340:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4edc14a3988 00100000:10000000:3.0:1788844755.950394:0:14340:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788844755.951925:0:14340:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788844755.951941:0:14340:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788844755.951956:0:14340:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788844755.951983:0:14340:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788844756.412775:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788844756.795207:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788844757.186486:0:14355:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788844757.186494:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eed0770000 from 6 10000000:01000000:0.0:1788844757.186500:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788844757.186574:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844757.186596:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844757.186606:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844757.186633:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267923072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788844757.186700:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844757.186755:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eefaf009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844757.187055:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267923072 00000100:00100000:2.0:1788844757.187064:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267923072 00000100:00100000:2.0:1788844757.187219:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788844757.187229:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+11:14355:x1875739267923072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844757.187241:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844757.187255:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2da37c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da375 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844757.187281:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2da37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da375 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844757.187293:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2da37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da375 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844757.187315:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65a00, rc 0) 00000100:00100000:2.0:1788844757.187359:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+12:14355:x1875739267923072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844757.187367:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788844757.193794:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267923072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844757.193823:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844757.193836:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844757.194786:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267923200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788844757.194861:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844757.194904:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6bb2300 going to sleep for 11 seconds 00000100:00100000:0.0:1788844757.198286:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267923200 00000100:00100000:0.0:1788844757.198303:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267923200 00000100:00100000:0.0:1788844757.198360:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788844757.198369:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+12:14355:x1875739267923200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788844757.198394:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788844757.198410:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788844757.198413:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788844757.198844:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267923200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788844757.198899:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788844757.198908:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844757.198919:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844757.199650:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+12:14355:x1875739267923200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1278us (4786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844757.199660:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788844757.435818:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788844757.818224:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788844758.462061:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844759.490398:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844760.505778:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788844760.567044:0:14642:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788844760.838107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788844760.838115:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788844760.838128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788844760.838131:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788844760.838134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788844760.838138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788844760.838142:0:36:0:(import.c:65:import_set_state_nolock()) ffff91eec57c4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788844760.838156:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91eec57c4800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:2.0:1788844760.838195:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc24fd880 x1875739267923456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788844760.840264:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:661a174e-3914-46cb-b31b-f72a0fba243b:3307:1875739267923328:0@lo:400:kworker.0 00000100:00100000:2.0:1788844760.840356:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844760.840462:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267923328 00000100:00100000:2.0:1788844760.840469:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267923328 00000100:00100000:2.0:1788844760.841384:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788844760.841401:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+12:3307:x1875739267923328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844760.841475:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+12:3307:x1875739267923328:12345-0@lo:400:kworker.0 Request processed in 80us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844760.841482:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788844760.841970:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875739267923456:0@lo:38:kworker.0 00000100:00100000:2.0:1788844760.842017:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844760.842089:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:661a174e-3914-46cb-b31b-f72a0fba243b:3307:1875739267923328:0@lo:400:kworker.0 00000100:00100000:0.0:1788844760.842807:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267923456 00000100:00100000:0.0:1788844760.842816:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267923456 00000100:00100000:0.0:1788844760.842854:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788844760.842861:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875739267923456:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788844760.842901:0:14360:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1788844760.843005:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7f1093851e2da383 00000004:00100000:0.0:1788844760.843024:0:14360:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788844760.843181:0:14360:0:(import.c:65:import_set_state_nolock()) ffff91eefb4e4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844760.843249:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875739267923456:12345-0@lo:38:kworker.0 Request processed in 387us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844760.843256:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788844760.843693:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91edc24fd880 x1875739267923456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788844770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788844760.843709:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788844760.843717:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788844760.843732:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788844760.843735:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec57c4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788844760.843742:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875739267923456:0@lo:38:kworker.0 00010000:00010000:3.0:1788844761.530793:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844762.553758:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844763.578284:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788844764.107103:0:14793:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe04678830 20000000:00000080:1.0:1788844764.107124:0:14793:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91eefcacec00 uarg=0000000000000000 20000000:01000000:1.0:1788844764.107163:0:14793:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788844764.107171:0:14793:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788844764.107177:0:14793:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788844764.111343:0:14794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788844764.115487:0:14793:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788844764.131145:0:14793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788844764.131201:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844764.131223:0:14793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed0d60600/0x7f1093851e2da34b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da344 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844764.131231:0:14793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844764.131275:0:14793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed0d60600/0x7f1093851e2da34b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2da344 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844764.131291:0:14793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eed0d60600/0x7f1093851e2da34b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2da344 expref: 11 pid: 14350 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844764.131322:0:14793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14793:1875739267923584:0@lo:104: 00000100:00100000:1.0:1788844764.131389:0:14793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844764.131441:0:14793:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788844764.133774:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267923584 00000100:00100000:0.0:1788844764.133790:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267923584 00000100:00100000:0.0:1788844764.133862:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788844764.133871:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:661a174e-3914-46cb-b31b-f72a0fba243b+3:14793:x1875739267923584:12345-0@lo:104: 00010000:00010000:0.0:1788844764.133888:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844764.134024:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788844764.134031:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:661a174e-3914-46cb-b31b-f72a0fba243b+3:14793:x1875739267923584:12345-0@lo:104: Request processed in 161us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844764.134039:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788844764.134140:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844764.134149:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.134232:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65200 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:3.0:1788844764.134237:0:14346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.134246:0:14346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788844764.134253:0:14346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844764.134260:0:14346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788844764.134304:0:14346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.134310:0:14346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788844764.134333:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.134341:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eed0d65200/0x7f1093851e2da344 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da34b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.134373:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844764.134378:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267923712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788844764.134384:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844764.134388:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844764.134423:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844764.134626:0:14793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14793:1875739267923584:0@lo:104: 00010000:00010000:1.0:1788844764.134655:0:14793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844764.135220:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267923712 00000100:00100000:3.0:1788844764.135226:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267923712 00010000:00010000:3.0:1788844764.135253:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed0d60600/0x7f1093851e2da34b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da344 expref: 12 pid: 14350 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844764.135283:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788844764.135291:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:661a174e-3914-46cb-b31b-f72a0fba243b+12:3308:x1875739267923712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788844764.135302:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844764.135307:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed0d60600/0x7f1093851e2da34b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da344 expref: 12 pid: 14350 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135316:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed0d60600/0x7f1093851e2da34b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2da344 expref: 12 pid: 14350 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135333:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed0d60600/0x7f1093851e2da34b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2da344 expref: 12 pid: 14350 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135346:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135355:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135370:0:14345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135377:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135383:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135396:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135402:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60400 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844764.135406:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135414:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135434:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844764.135453:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844764.135496:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:661a174e-3914-46cb-b31b-f72a0fba243b+11:3308:x1875739267923712:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844764.135504:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788844764.135606:0:14793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844764.135613:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844764.135619:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da38a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844764.136871:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267923712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788844764.605068:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844765.625862:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788844765.952710:0:14355:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788844765.952724:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eed0770000 from 10 10000000:01000000:2.0:1788844765.952731:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788844765.952795:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844765.952809:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844765.952824:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844765.952858:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267923840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788844765.952950:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844765.953013:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed84e3540 going to sleep for 11 seconds 00000100:00080000:2.0:1788844765.953036:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788844765.953042:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788844765.953045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788844765.953049:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788844765.953247:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267923840 00000100:00100000:2.0:1788844765.953266:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267923840 00000100:00100000:2.0:1788844765.953330:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788844765.953341:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+11:14355:x1875739267923840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844765.953359:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844765.953376:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed0d64000/0x7f1093851e2da398 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da391 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844765.953420:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d64000/0x7f1093851e2da398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da391 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844765.953433:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed0d64000/0x7f1093851e2da398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da391 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844765.953444:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64000, rc 0) 00000100:00100000:2.0:1788844765.953490:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+12:14355:x1875739267923840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844765.953497:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788844765.953579:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788844765.953592:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267923968:0@lo:400:kworker.0 00000100:00100000:2.0:1788844765.953625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844765.953672:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267923968 00000100:00100000:2.0:1788844765.953676:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267923968 00000100:00100000:2.0:1788844765.953881:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788844765.953907:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267923968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844765.954034:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267923968:12345-0@lo:400:kworker.0 Request processed in 140us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844765.954041:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844765.957107:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788844755/real 1788844755] req@ffff91edc12f0a80 x1875739267920768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788844765 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844765.957143:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91edc12f0a80 x1875739267920768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788844765 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844765.957158:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788844755/real 1788844755] req@ffff91edc12f0380 x1875739267920640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788844765 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844765.957172:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91edc12f0380 x1875739267920640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788844765 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788844765.957197:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788844765.957227:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788844765.957232:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267920768:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788844765.957240:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eefb385800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788844765.957254:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00010000:00080000:2.0:1788844765.957258:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91edc24ff800 x1875739267923968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844765.957260:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267920640:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788844765.957300:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267923968:0@lo:400:kworker.0 00000100:00080000:2.0:1788844765.957352:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788844765.957357:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788844765.957363:0:8:0:(import.c:65:import_set_state_nolock()) ffff91eefb385800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788844765.957368:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1788844765.957374:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788844765.957382:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91eefb385800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:2.0:1788844765.957429:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc24ff800 x1875739267924096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788844765.957458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788844765.957462:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788844765.957464:0:8:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788844765.957469:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1788844765.957471:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788844765.957475:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eec3808800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:2.0:1788844765.957489:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc24fca80 x1875739267924224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788844765.957527:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267923840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844765.957633:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844765.957644:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844765.957715:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267924352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844765.957777:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844765.957816:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4f69240 going to sleep for 11 seconds 00000100:00100000:2.0:1788844765.957833:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267924352 00000100:00100000:2.0:1788844765.957839:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267924352 00000100:00100000:2.0:1788844765.957877:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788844765.957886:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+12:14355:x1875739267924352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844765.958704:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267924096:0@lo:8:kworker.0 00000400:00000100:0.0:1788844765.958772:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875739267924096 offset 0 length 520: 4 00000100:00100000:0.0:1788844765.958815:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267924224:0@lo:8:kworker.0 00000100:00100000:2.0:1788844765.960989:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+12:14355:x1875739267924352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3094us (3201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844765.961004:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000400:00000100:0.0:1788844765.961173:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875739267924224 offset 0 length 520: 4 00000100:00100000:2.0:1788844765.962812:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267924352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844765.962881:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267924480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844765.963048:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844765.963149:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4f69240 going to sleep for 11 seconds 00000100:00100000:2.0:1788844765.963189:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267924480 00000100:00100000:2.0:1788844765.963195:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267924480 00000100:00100000:2.0:1788844765.963248:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788844765.963263:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+12:14355:x1875739267924480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844765.963492:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+12:14355:x1875739267924480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844765.963500:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788844765.967110:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267924480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788844765.967885:0:14854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788844765.967969:0:14355:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788844765.967987:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788844765.967999:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844765.968011:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844766.651301:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788844767.036707:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788844767.674999:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844768.697717:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844769.721781:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844770.745700:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788844771.070563:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788844771.070571:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788844771.070574:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788844771.070578:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788844771.070621:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:661a174e-3914-46cb-b31b-f72a0fba243b:3306:1875739267924608:0@lo:400:kworker.0 00000100:00100000:2.0:1788844771.070696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844771.070757:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267924736:0@lo:400:kworker.0 00000100:00100000:2.0:1788844771.070784:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844771.070817:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267924608 00000100:00100000:2.0:1788844771.070824:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267924608 00000100:00100000:2.0:1788844771.070866:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788844771.070876:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+12:3306:x1875739267924608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844771.070921:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+12:3306:x1875739267924608:12345-0@lo:400:kworker.0 Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844771.070928:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788844771.070962:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267924736 00000100:00100000:2.0:1788844771.070975:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267924736 00000100:00100000:2.0:1788844771.071003:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788844771.071010:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267924736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844771.071047:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267924736:12345-0@lo:400:kworker.0 Request processed in 38us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844771.073608:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788844771.073677:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:661a174e-3914-46cb-b31b-f72a0fba243b:3306:1875739267924608:0@lo:400:kworker.0 00010000:00080000:2.0:1788844771.073725:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91edc24ff100 x1875739267924736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844771.073738:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267924736:0@lo:400:kworker.0 00000020:01000004:1.0:1788844771.231829:0:15042:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788844771.231833:0:15042:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788844771.232078:0:15042:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91eec57c5800 00000020:01000004:3.0:1788844771.232094:0:15042:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788844771.232107:0:15042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788844771.232120:0:15042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91eec2decd28) 00000020:00000080:3.0:1788844771.232135:0:15042:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788844771.268752:0:15042:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788844771.269056:0:15042:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788844771.269839:0:15042:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788844771.270070:0:15042:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788844771.270295:0:15042:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788844771.270712:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 221: rc = 0 00100000:10000000:1.0:1788844771.270809:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 221: rc = 0 00100000:10000000:2.0:1788844771.278584:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 221: rc = 0 00100000:10000000:2.0:1788844771.280724:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1788844771.282275:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 641: rc = 0 00100000:10000000:2.0:1788844771.282611:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 641: rc = 0 00100000:10000000:2.0:1788844771.283116:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:2.0:1788844771.283465:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 641: rc = 0 00100000:10000000:2.0:1788844771.283991:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00000020:00000080:2.0:1788844771.284678:0:15042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788844771.284691:0:15042:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788844771.284701:0:15042:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7f1093851e2da3a6 00000020:01000004:2.0:1788844771.284709:0:15042:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788844771.284732:0:15042:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788844771.284736:0:15042:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788844771.284742:0:15042:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788844771.284747:0:15042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788844771.284757:0:15042:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91eeff3e8000) 00000020:00000080:2.0:1788844771.284766:0:15042:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788844771.289399:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788844771.289661:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788844771.289668:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788844771.295294:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788844771.295323:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788844771.308265:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788844771.308281:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788844771.309854:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788844771.310264:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788844771.310271:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788844771.310911:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788844771.310919:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788844771.332742:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788844771.333221:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788844771.333228:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788844771.337116:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788844771.337278:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788844771.338872:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788844771.338884:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788844771.342778:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788844771.343899:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788844771.343909:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788844771.353947:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788844771.353964:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788844771.400396:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788844771.400643:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788844771.400650:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788844771.408571:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788844771.408583:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788844771.408984:0:15042:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788844771.409010:0:15042:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788844771.409016:0:15042:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788844771.432361:0:15042:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788844771.432402:0:15042:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.143@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788844771.432406:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788844771.432409:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788844771.432410:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844771.432411:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844771.432413:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844771.432414:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844771.432415:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788844771.432417:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844771.432418:0:15042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788844771.432421:0:15042:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788844771.432423:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788844771.432424:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788844771.432425:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844771.432426:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844771.432428:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844771.432429:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844771.432430:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788844771.432431:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844771.432432:0:15042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788844771.432460:0:15042:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788844771.432486:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267924864:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788844771.432641:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844771.432686:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec1254a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788844771.432939:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267924864 00000100:00100000:2.0:1788844771.432948:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267924864 00000100:00100000:2.0:1788844771.433012:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788844771.433022:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+12:15042:x1875739267924864:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788844771.433100:0:14350:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788844771.433104:0:14350:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788844771.433108:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788844771.447566:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+12:15042:x1875739267924864:12345-0@lo:253:mount.lustre.0 Request processed in 14515us (14894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844771.447581:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788844771.447743:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267924864:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788844771.447759:0:15042:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788844771.447762:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788844771.447764:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788844771.447766:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844771.447767:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844771.447768:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844771.447770:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844771.447771:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788844771.447773:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844771.447774:0:15042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788844771.447819:0:15042:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91eec57c5800 from lustre-OST0000 10000000:01000000:0.0:1788844771.447846:0:15042:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788844771.447848:0:15042:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788844771.447855:0:15042:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91eec2de99b8 local copy 00010000:00010000:0.0:1788844771.447865:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2a3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844771.448251:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267924992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788844771.448294:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844771.448388:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed86d3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844771.454439:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267924992 00000100:00100000:2.0:1788844771.454454:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267924992 00000100:00100000:2.0:1788844771.454511:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788844771.454522:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+12:15042:x1875739267924992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788844771.454845:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+12:15042:x1875739267924992:12345-0@lo:501:mount.lustre.0 Request processed in 324us (6549us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788844771.454854:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788844771.455158:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267924992:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788844771.455182:0:15042:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788844771.455373:0:15042:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788844771.455382:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2a3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844771.455393:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2a3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844771.455419:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91eec57c5800 10000000:01000000:1.0:1788844771.455423:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788844771.455428:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91eec2de99b8 10000000:01000000:1.0:1788844771.455430:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788844771.455433:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91eec2de99b8 from 1 10000000:01000000:1.0:1788844771.455437:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788844771.455471:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d61800/0x7f1093851e2da3b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844771.455480:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed0d61800/0x7f1093851e2da3b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844771.455490:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed0d61800/0x7f1093851e2da3b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844771.455518:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788844771.455624:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.455650:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788844771.457908:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267925120 00000100:00100000:0.0:1788844771.457922:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267925120 00000100:00100000:0.0:1788844771.457995:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788844771.458005:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+12:15042:x1875739267925120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788844771.458021:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844771.458042:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0031000/0x7f1093851e2da3bb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da3b4 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.458088:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0031000/0x7f1093851e2da3bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da3b4 expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.458099:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0031000/0x7f1093851e2da3bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da3b4 expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.458109:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031000, rc 0) 00000100:00100000:0.0:1788844771.458198:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+13:15042:x1875739267925120:12345-0@lo:101:mount.lustre.0 Request processed in 194us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844771.458205:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788844771.458343:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844771.458365:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed0d61800/0x7f1093851e2da3b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3bb expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.458386:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed0d61800/0x7f1093851e2da3b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da3bb expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844771.458409:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788844771.458429:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d61800/0x7f1093851e2da3b4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3bb expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.458436:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed0d61800/0x7f1093851e2da3b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3bb expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844771.458445:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788844771.458450:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788844771.458455:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788844771.458458:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788844771.458481:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025600/0x7f1093851e2da3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.458488:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0025600/0x7f1093851e2da3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.458496:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0025600/0x7f1093851e2da3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844771.458514:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788844771.458610:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844771.458636:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eef9146000 going to sleep for 11 seconds 00000100:00100000:2.0:1788844771.458712:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267925248 00000100:00100000:2.0:1788844771.458718:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267925248 00000100:00100000:2.0:1788844771.458742:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788844771.458767:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+13:15042:x1875739267925248:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788844771.458776:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844771.458785:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed0d64800/0x7f1093851e2da3c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da3c2 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.458800:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d64800/0x7f1093851e2da3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da3c2 expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.458808:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed0d64800/0x7f1093851e2da3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da3c2 expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.458815:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d64800, rc 0) 00000100:00100000:2.0:1788844771.458853:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+14:15042:x1875739267925248:12345-0@lo:101:mount.lustre.0 Request processed in 99us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844771.458858:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788844771.459000:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844771.459012:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0025600/0x7f1093851e2da3c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3c9 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.459026:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0025600/0x7f1093851e2da3c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da3c9 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788844771.459877:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788844771.462953:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788844771.463275:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788844771.463349:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788844771.463384:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788844771.463433:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788844771.463469:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788844771.463501:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788844771.463588:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788844771.463597:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788844771.463681:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788844771.463743:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844771.467980:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eef9146cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844771.474949:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267925376 00000100:00100000:2.0:1788844771.474964:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267925376 00000100:00100000:3.0:1788844771.475250:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788844771.475261:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+14:15042:x1875739267925376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788844771.478020:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+14:15042:x1875739267925376:12345-0@lo:501:mount.lustre.0 Request processed in 2751us (14266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844771.478034:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788844771.492072:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788844771.492146:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925504:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788844771.492231:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.492286:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844771.492391:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267925504 00000100:00100000:2.0:1788844771.492398:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267925504 00000100:00100000:2.0:1788844771.492451:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788844771.492461:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+14:15042:x1875739267925504:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788844771.493152:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+14:15042:x1875739267925504:12345-0@lo:503:mount.lustre.0 Request processed in 689us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844771.493161:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788844771.493348:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925504:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788844771.494387:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788844771.494479:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788844771.494620:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.494661:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844771.497032:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267925632 00000100:00100000:3.0:1788844771.497049:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267925632 00000100:00100000:3.0:1788844771.497122:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788844771.497132:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+14:15042:x1875739267925632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788844771.497460:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+14:15042:x1875739267925632:12345-0@lo:502:mount.lustre.0 Request processed in 329us (2922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844771.497477:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788844771.497618:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788844771.497906:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788844771.497957:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788844771.497985:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788844771.498027:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788844771.498058:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788844771.498090:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788844771.498139:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788844771.498176:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788844771.498211:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788844771.498264:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788844771.498330:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788844771.498378:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788844771.498420:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925760:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788844771.498632:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844771.498684:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed86d39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844771.498923:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267925760 00000100:00100000:3.0:1788844771.498931:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267925760 00000100:00100000:3.0:1788844771.498965:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788844771.498972:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+14:15042:x1875739267925760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788844771.499156:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+14:15042:x1875739267925760:12345-0@lo:502:mount.lustre.0 Request processed in 183us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844771.499163:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788844771.499627:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925760:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788844771.499718:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788844771.499730:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788844771.501612:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788844771.501621:0:15056:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788844771.501627:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788844771.501629:0:15056:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788844771.501635:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788844771.501663:0:15056:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91eeea77b370) 00000020:00000080:2.0:1788844771.501687:0:15056:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788844771.501694:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788844771.501942:0:15056:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eec57c5800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788844771.501950:0:15056:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788844771.501957:0:15056:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7f1093851e2da3d7 00010000:00010000:0.0:1788844771.516146:0:15056:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788844771.516620:0:15056:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1788844771.525695:0:15056:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788844771.532689:0:15056:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788844771.532702:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788844771.532709:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844771.532711:0:15056:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788844771.532714:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788844771.532717:0:15056:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788844771.532718:0:15056:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788844771.532720:0:15056:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788844771.532721:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788844771.532723:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844771.532725:0:15056:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788844771.532727:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788844771.532731:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844771.532732:0:15056:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788844771.532735:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788844771.532737:0:15056:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788844771.532739:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788844771.532741:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844771.532743:0:15056:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788844771.532745:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788844771.532747:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844771.532749:0:15056:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788844771.532752:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788844771.532821:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788844771.532825:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788844771.532826:0:15056:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788844771.532829:0:15056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788844771.534778:0:15042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788844771.534822:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788844771.534849:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025600/0x7f1093851e2da3c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3c9 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844771.534862:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0025600/0x7f1093851e2da3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3c9 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844771.534871:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eec57c5800 from 1 10000000:01000000:1.0:1788844771.534873:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788844771.534910:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844771.534918:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844771.534937:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844771.534961:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788844771.535029:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.535071:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844771.539290:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267925888 00000100:00100000:3.0:1788844771.539314:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267925888 00000100:00100000:3.0:1788844771.539601:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788844771.539613:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+14:15042:x1875739267925888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844771.539632:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844771.539650:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0024e00/0x7f1093851e2da3e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da3de expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.539678:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024e00/0x7f1093851e2da3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da3de expref: 15 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.539689:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0024e00/0x7f1093851e2da3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da3de expref: 15 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.539697:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024e00, rc 0) 00000100:00100000:3.0:1788844771.539769:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267925888:12345-0@lo:101:mount.lustre.0 Request processed in 159us (4740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844771.539777:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788844771.544710:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267925888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788844771.544739:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844771.544753:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788844771.545284:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788844771.545635:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788844771.552824:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788844771.552930:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788844771.553032:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788844771.553044:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788844771.553389:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788844771.553470:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.553583:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844771.559094:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267926016 00000100:00100000:2.0:1788844771.559113:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267926016 00000100:00100000:2.0:1788844771.559178:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788844771.559189:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267926016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788844771.559521:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267926016:12345-0@lo:501:mount.lustre.0 Request processed in 334us (6050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844771.559530:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788844771.559780:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788844771.559835:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788844771.559887:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.559983:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844771.563706:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267926144 00000100:00100000:3.0:1788844771.563732:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267926144 00000100:00100000:3.0:1788844771.563781:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788844771.563791:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267926144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788844771.564031:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267926144:12345-0@lo:503:mount.lustre.0 Request processed in 241us (4143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844771.564039:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788844771.564149:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926144:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788844771.564736:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788844771.564812:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788844771.564862:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.564901:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844771.565022:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267926272 00000100:00100000:3.0:1788844771.565028:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267926272 00000100:00100000:3.0:1788844771.565051:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788844771.565058:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267926272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788844771.565210:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267926272:12345-0@lo:502:mount.lustre.0 Request processed in 151us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844771.565217:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788844771.565312:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788844771.565580:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788844771.565628:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788844771.565695:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788844771.565734:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788844771.565764:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788844771.565815:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788844771.565855:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788844771.565891:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788844771.565918:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788844771.565958:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.565979:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff6a1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844771.566057:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267926400 00000100:00100000:2.0:1788844771.566124:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267926400 00000100:00100000:2.0:1788844771.566151:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788844771.566157:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267926400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788844771.566324:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267926400:12345-0@lo:502:mount.lustre.0 Request processed in 165us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844771.566331:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788844771.566458:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788844771.568163:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788844771.568184:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788844771.575051:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844771.575067:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844771.575070:0:15060:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788844771.575078:0:15060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eec57c5800 00000020:00000080:3.0:1788844771.575081:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788844771.575089:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844771.575091:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844771.575093:0:15060:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788844771.575095:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844771.575097:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844771.575098:0:15060:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788844771.575101:0:15060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eec57c5800 00000020:00000080:3.0:1788844771.575103:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788844771.575237:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844771.575242:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844771.575243:0:15060:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788844771.575247:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844771.575264:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844771.575265:0:15060:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788844771.575269:0:15060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91eec57c5800 00000020:00000080:3.0:1788844771.575271:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788844771.589447:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844771.589459:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844771.589461:0:15060:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788844771.589466:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788844771.589650:0:15042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788844771.589701:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788844771.589720:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.589732:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844771.589786:0:15042:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788844771.589790:0:15042:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91eec57c5800 10000000:01000000:0.0:1788844771.589793:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91eec57c5800 10000000:01000000:0.0:1788844771.589797:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788844771.589802:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eec57c5800 from 1 10000000:01000000:0.0:1788844771.589805:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788844771.589840:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031200/0x7f1093851e2da3ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.589848:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0031200/0x7f1093851e2da3ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.589859:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0031200/0x7f1093851e2da3ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844771.589883:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788844771.589950:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844771.589993:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec1254a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788844771.590051:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267926528 00000100:00100000:3.0:1788844771.590059:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267926528 00000100:00100000:3.0:1788844771.590105:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788844771.590115:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267926528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844771.590128:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844771.590141:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0024600/0x7f1093851e2da3f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da3ec expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.590164:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024600/0x7f1093851e2da3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da3ec expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.590174:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0024600/0x7f1093851e2da3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da3ec expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844771.590183:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024600, rc 0) 00000100:00100000:3.0:1788844771.590222:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+16:15042:x1875739267926528:12345-0@lo:101:mount.lustre.0 Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844771.590229:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788844771.590325:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788844771.590339:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0031200/0x7f1093851e2da3ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3f3 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.590348:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0031200/0x7f1093851e2da3ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da3f3 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788844771.590960:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788844771.591523:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788844771.591788:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788844771.591832:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788844771.591862:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788844771.591907:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788844771.591939:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788844771.591981:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788844771.592012:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788844771.592044:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788844771.592094:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788844771.592131:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788844771.592182:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788844771.592235:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788844771.592272:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788844771.592324:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788844771.592376:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788844771.592411:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788844771.592445:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788844771.592493:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788844771.592532:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788844771.592594:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788844771.592658:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788844771.592697:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788844771.592733:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788844771.592801:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788844771.592840:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788844771.592874:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788844771.592940:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788844771.592971:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788844771.593040:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788844771.593056:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788844771.605635:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788844771.605716:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844771.605764:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec1254a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788844771.611806:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267926656 00000100:00100000:1.0:1788844771.611824:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267926656 00000100:00100000:1.0:1788844771.611893:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788844771.611904:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+16:15042:x1875739267926656:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788844771.612206:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+16:15042:x1875739267926656:12345-0@lo:501:mount.lustre.0 Request processed in 302us (6488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844771.612213:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788844771.614692:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788844771.614755:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788844771.614825:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.614863:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2dd0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788844771.618585:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267926784 00000100:00100000:1.0:1788844771.618601:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267926784 00000100:00100000:1.0:1788844771.618672:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788844771.618683:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+16:15042:x1875739267926784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788844771.618967:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+16:15042:x1875739267926784:12345-0@lo:503:mount.lustre.0 Request processed in 285us (4140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844771.618975:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788844771.619060:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926784:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788844771.619659:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788844771.619742:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788844771.619798:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.619837:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267926912 00000100:00100000:1.0:1788844771.619843:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267926912 00000100:00100000:1.0:1788844771.619876:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788844771.619883:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+16:15042:x1875739267926912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788844771.620066:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+16:15042:x1875739267926912:12345-0@lo:502:mount.lustre.0 Request processed in 183us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844771.620073:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788844771.620121:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2dd0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788844771.620141:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267926912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788844771.620369:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788844771.620429:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788844771.620467:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788844771.620520:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788844771.620608:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788844771.620660:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788844771.620697:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788844771.620734:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788844771.620786:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788844771.620820:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788844771.620847:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788844771.620885:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788844771.620913:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788844771.620938:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788844771.620977:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788844771.621008:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788844771.621033:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788844771.621071:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788844771.621102:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788844771.621128:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788844771.621186:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788844771.621216:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788844771.621243:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788844771.631157:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788844771.631244:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788844771.631280:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788844771.631347:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788844771.631385:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788844771.631421:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788844771.631473:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788844771.631508:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788844771.631564:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788844771.631600:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788844771.631646:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788844771.631695:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788844771.631758:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788844771.631827:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788844771.631861:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788844771.631934:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788844771.631975:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788844771.632030:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267927040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788844771.632108:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.632165:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267927040 00000100:00100000:1.0:1788844771.632172:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267927040 00000100:00100000:1.0:1788844771.632216:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788844771.632225:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+16:15042:x1875739267927040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788844771.632464:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+16:15042:x1875739267927040:12345-0@lo:502:mount.lustre.0 Request processed in 238us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844771.632472:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788844771.632524:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2dd0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788844771.632573:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267927040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788844771.632642:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788844771.632650:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788844771.646109:0:15065:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788844771.646128:0:15065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91eef910cd28) 00000020:00000080:0.0:1788844771.646152:0:15065:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788844771.646254:0:15065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eec57c5800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788844771.646258:0:15065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eec57c5800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788844771.646261:0:15065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eec57c5800 3 00010000:00080000:0.0:1788844771.646295:0:15065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eef3166800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.143@tcp at head 00010000:00010000:0.0:1788844771.647997:0:15065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788844771.648189:0:15065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788844771.648223:0:15065:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788844771.648237:0:15065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7f1093851e2da401 00000100:00080000:0.0:1788844771.648248:0:15065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788844771.648253:0:15065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91eef3166800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:0.0:1788844771.648291:0:15065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eefb06b100 x1875739267927168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788844771.648333:0:15065:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788844771.648370:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788844771.648375:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788844771.648378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788844771.648381:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788844771.649471:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875739267927168:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788844771.649584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844771.649692:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267927168 00000100:00100000:2.0:1788844771.649700:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267927168 00000100:00100000:2.0:1788844771.649741:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788844771.649749:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875739267927168:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788844771.649907:0:14360:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1788844771.649956:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7f1093851e2da408 00000004:00100000:2.0:1788844771.649970:0:14360:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788844771.650004:0:14360:0:(import.c:65:import_set_state_nolock()) ffff91eec6b33000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788844771.650075:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875739267927168:12345-0@lo:38:llog_process_th.0 Request processed in 325us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844771.650082:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788844771.650160:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91eefb06b100 x1875739267927168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788844781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844771.650171:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788844771.650180:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788844771.650189:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788844771.650194:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788844771.650204:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eef3166800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788844771.650211:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875739267927168:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788844771.653794:0:15065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788844771.653914:0:15042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788844771.653937:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788844771.653953:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031200/0x7f1093851e2da3ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3f3 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844771.653964:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0031200/0x7f1093851e2da3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da3f3 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788844771.654032:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788844771.654034:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788844771.654036:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788844771.654037:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788844771.654038:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788844771.654040:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788844771.654041:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788844771.654043:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788844771.654045:0:15042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788844771.654048:0:15042:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788844771.654051:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788844771.654052:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788844771.654054:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788844771.654055:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788844771.654056:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788844771.654057:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788844771.654059:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788844771.654060:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788844771.654061:0:15042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788844771.654088:0:15042:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788844771.654108:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267927296:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788844771.654175:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844771.654218:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267927296 00000100:00100000:1.0:1788844771.654231:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267927296 00000100:00100000:1.0:1788844771.654272:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788844771.654281:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+16:15042:x1875739267927296:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788844771.654331:0:14350:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788844771.654344:0:14350:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788844771.654666:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec2dd0540 going to sleep for 11 seconds 20000000:01000000:1.0:1788844771.730061:0:14350:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788844771.730078:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788844771.731066:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788844771.731073:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788844771.731095:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.731112:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2da37c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da375 expref: 16 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.731119:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.731154:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2da37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2da375 expref: 16 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.731169:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2da37c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2da375 expref: 16 pid: 14352 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844771.731183:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24ff100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875739267927424:0@lo:104: 00000100:00100000:2.0:1788844771.731274:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844771.731331:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59df600 going to sleep for 11 seconds 00000100:00100000:1.0:1788844771.731405:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267927424 00000100:00100000:1.0:1788844771.731413:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267927424 00000100:00100000:1.0:1788844771.731466:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788844771.731476:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:661a174e-3914-46cb-b31b-f72a0fba243b+3:14374:x1875739267927424:12345-0@lo:104: 00010000:00010000:1.0:1788844771.731488:0:14341:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844771.731571:0:14341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788844771.731577:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:661a174e-3914-46cb-b31b-f72a0fba243b+3:14374:x1875739267927424:12345-0@lo:104: Request processed in 104us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844771.731584:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788844771.731755:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844771.731763:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.732294:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031600 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:0.0:1788844771.732309:0:14346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.732318:0:14346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788844771.732324:0:14346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844771.732340:0:14346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788844771.732376:0:14346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.732383:0:14346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788844771.732402:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.732408:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da37c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844771.732425:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844771.732426:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844771.732428:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844771.732517:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24ff100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875739267927424:0@lo:104: 00010000:00010000:2.0:1788844771.732583:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844771.732617:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267927552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788844771.732662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844771.733217:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267927552 00000100:00100000:2.0:1788844771.733234:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267927552 00010000:00010000:2.0:1788844771.733260:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2da37c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da375 expref: 17 pid: 14352 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844771.733306:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788844771.733315:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:661a174e-3914-46cb-b31b-f72a0fba243b+17:3308:x1875739267927552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788844771.733328:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844771.733333:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2da37c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da375 expref: 17 pid: 14352 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733345:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2da37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2da375 expref: 17 pid: 14352 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733363:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed0d65a00/0x7f1093851e2da37c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2da375 expref: 17 pid: 14352 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733376:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733384:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788844771.733397:0:14345:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003217098s 00010000:00010000:2.0:1788844771.733401:0:14345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733407:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733413:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733429:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733434:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64400 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844771.733438:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733446:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733460:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733469:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844771.733509:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:661a174e-3914-46cb-b31b-f72a0fba243b+16:3308:x1875739267927552:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844771.733515:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788844771.733558:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733565:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844771.733572:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed0d64400/0x7f1093851e2da40f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844771.733604:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267927552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788844771.752977:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+15:15042:x1875739267927296:12345-0@lo:253:mount.lustre.0 Request processed in 98687us (98791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844771.753011:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788844771.753133:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15042:1875739267927296:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788844771.753149:0:15042:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788844771.753152:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788844771.753154:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788844771.753161:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788844771.753163:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788844771.753164:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788844771.753166:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788844771.753167:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788844771.753169:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788844771.753170:0:15042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788844771.753185:0:15042:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788844771.766286:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788844771.766463:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788844771.767703:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788844771.767917:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788844771.768081:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788844771.768312:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788844771.769582:0:15042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788844771.769943:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788844771.938763:0:15042:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788844771.938774:0:15042:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788844771.938828:0:15042:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788844771.938901:0:15042:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788844771.938915:0:15042:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788844771.938943:0:15042:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788844772.798564:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788844773.754651:0:14355:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788844773.754661:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eed0770000 from 7 10000000:01000000:0.0:1788844773.754666:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788844773.754710:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844773.754735:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844773.754747:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844773.754779:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267927680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788844773.754849:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844773.754906:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec7050780 going to sleep for 11 seconds 00000100:00100000:2.0:1788844773.755012:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267927680 00000100:00100000:2.0:1788844773.755021:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267927680 00000100:00100000:2.0:1788844773.755077:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788844773.755087:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+15:14355:x1875739267927680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844773.755112:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844773.755127:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed0d65200/0x7f1093851e2da41d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da416 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844773.755154:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d65200/0x7f1093851e2da41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da416 expref: 16 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844773.755166:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed0d65200/0x7f1093851e2da41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da416 expref: 16 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844773.755176:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d65200, rc 0) 00000100:00100000:2.0:1788844773.755227:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+16:14355:x1875739267927680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844773.755233:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788844773.755583:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267927680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788844773.755600:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844773.755610:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844773.755668:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267927808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788844773.755704:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844773.755722:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed8587d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788844773.759291:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267927808 00000100:00100000:2.0:1788844773.759307:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267927808 00000100:00100000:2.0:1788844773.759386:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788844773.759395:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+16:14355:x1875739267927808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788844773.759422:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788844773.759439:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788844773.759442:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788844773.759606:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+16:14355:x1875739267927808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 212us (3900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844773.759614:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788844773.761036:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267927808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788844773.761130:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788844773.761140:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844773.761151:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844773.818037:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844774.842950:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844775.867700:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788844776.697930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788844776.697937:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788844776.697940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788844776.697951:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788844776.698098:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267928192:0@lo:400:kworker.0 00000100:00100000:1.0:1788844776.698172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844776.698275:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267928192 00000100:00100000:1.0:1788844776.698283:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267928192 00000100:00100000:1.0:1788844776.698341:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788844776.698350:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267928192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844776.698403:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267928192:12345-0@lo:400:kworker.0 Request processed in 54us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844776.698410:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788844776.698444:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788844776.698477:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edc12f0a80 x1875739267928192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844776.698492:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267928192:0@lo:400:kworker.0 00000100:00100000:0.0:1788844776.698591:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267928064:0@lo:400:kworker.0 00000100:00100000:0.0:1788844776.698628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844776.698659:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788844776.698666:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:661a174e-3914-46cb-b31b-f72a0fba243b:3306:1875739267927936:0@lo:400:kworker.0 00000100:00100000:0.0:1788844776.698696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844776.698728:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267927936 00000100:00100000:0.0:1788844776.698732:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267927936 00000100:00100000:0.0:1788844776.698761:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788844776.698768:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+16:3306:x1875739267927936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844776.698810:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+16:3306:x1875739267927936:12345-0@lo:400:kworker.0 Request processed in 42us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844776.698817:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788844776.698852:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:661a174e-3914-46cb-b31b-f72a0fba243b:3306:1875739267927936:0@lo:400:kworker.0 00000100:00100000:1.0:1788844776.698974:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267928064 00000100:00100000:1.0:1788844776.698979:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267928064 00000100:00100000:1.0:1788844776.699014:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788844776.699021:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267928064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844776.699064:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267928064:12345-0@lo:400:kworker.0 Request processed in 43us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844776.699070:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788844776.699099:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edc12f0380 x1875739267928064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844776.699110:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267928064:0@lo:400:kworker.0 00010000:00010000:2.0:1788844776.890785:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788844777.274113:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788844777.928905:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844778.943545:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844779.961700:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788844779.988719:0:15411:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788844780.858941:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788844765/real 1788844765] req@ffff91edc24ff800 x1875739267924096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788844780 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844780.858971:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91edc24ff800 x1875739267924096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788844780 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844780.858982:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788844765/real 1788844765] req@ffff91edc24fca80 x1875739267924224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788844780 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844780.858994:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91edc24fca80 x1875739267924224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788844780 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788844780.859014:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eefb385800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788844780.859033:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788844780.859037:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267924096:0@lo:8:kworker.0 00000100:00080000:0.0:1788844780.859042:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788844780.859048:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788844780.859051:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267924224:0@lo:8:kworker.0 00000100:00080000:1.0:1788844780.859191:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788844780.859196:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788844780.859199:0:36:0:(import.c:65:import_set_state_nolock()) ffff91eefb385800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788844780.859203:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:1.0:1788844780.859208:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788844780.859216:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91eefb385800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1788844780.859236:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc12f0a80 x1875739267928448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788844780.859250:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788844780.859252:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788844780.859254:0:36:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788844780.859257:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:1.0:1788844780.859259:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788844780.859262:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eec3808800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1788844780.859274:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc12f1f80 x1875739267928576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788844780.859325:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267928704:0@lo:400:kworker.0 00000100:00100000:1.0:1788844780.859386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844780.859434:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844780.859440:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267928832:0@lo:400:kworker.0 00000100:00100000:1.0:1788844780.859462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844780.859496:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267928704 00000100:00100000:1.0:1788844780.859504:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267928704 00000100:00100000:1.0:1788844780.859559:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267928832 00000100:00100000:1.0:1788844780.859563:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267928832 00000100:00100000:1.0:1788844780.859601:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788844780.859609:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267928704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844780.859660:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267928704:12345-0@lo:400:kworker.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844780.859667:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788844780.859683:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788844780.859689:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267928832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844780.859716:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267928832:12345-0@lo:400:kworker.0 Request processed in 28us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844780.859722:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788844780.859742:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788844780.859766:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edc12f3100 x1875739267928832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844780.859778:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267928832:0@lo:400:kworker.0 00010000:00080000:1.0:1788844780.859787:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edc12f1180 x1875739267928704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844780.859795:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267928704:0@lo:400:kworker.0 00000100:00100000:0.0:1788844780.860383:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844780.860397:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:661a174e-3914-46cb-b31b-f72a0fba243b:3307:1875739267928320:0@lo:400:kworker.0 00000100:00100000:0.0:1788844780.860440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844780.860504:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267928448:0@lo:8:kworker.0 00000100:00100000:0.0:1788844780.860553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844780.860571:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267928576:0@lo:8:kworker.0 00000100:00100000:0.0:1788844780.860591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844780.862833:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267928320 00000100:00100000:2.0:1788844780.862848:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267928320 00000100:00100000:2.0:1788844780.862902:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788844780.862911:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+16:3307:x1875739267928320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844780.862991:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+16:3307:x1875739267928320:12345-0@lo:400:kworker.0 Request processed in 81us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844780.862998:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788844780.863037:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267928448 00000100:00100000:2.0:1788844780.863041:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267928448 00000100:00100000:2.0:1788844780.863059:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267928576 00000100:00100000:2.0:1788844780.863062:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267928576 00000100:00100000:2.0:1788844780.863070:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788844780.863075:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875739267928448:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788844780.863098:0:15043:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:2.0:1788844780.863138:0:15043:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7f1093851e2da424 00002000:00100000:2.0:1788844780.863152:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91eec6b31800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788844780.863156:0:15043:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788844780.863165:0:15043:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788844780.863456:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788844780.863479:0:15043:0:(import.c:65:import_set_state_nolock()) ffff91eec6b35800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788844780.863522:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875739267928448:12345-0@lo:8:kworker.0 Request processed in 446us (2988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844780.863529:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788844780.863560:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788844780.863564:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875739267928576:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788844780.863575:0:15043:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788844780.863598:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875739267928576:12345-0@lo:8:kworker.0 Request processed in 32us (3006us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788844780.863603:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788844780.863643:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:661a174e-3914-46cb-b31b-f72a0fba243b:3307:1875739267928320:0@lo:400:kworker.0 00010000:00080000:2.0:1788844780.863676:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edc12f0a80 x1875739267928448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788844800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788844780.863686:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788844780.863692:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788844780.863698:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788844780.863703:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788844780.863705:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eefb385800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788844780.863718:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788844780.863722:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267928448:0@lo:8:kworker.0 00000100:00080000:2.0:1788844780.863732:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788844780.863737:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788844780.863740:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267928576:0@lo:8:kworker.0 00000004:00080000:2.0:1788844780.863802:0:14381:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788844780.863819:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1875739267929088:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788844780.863847:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844780.863862:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed85870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844780.863875:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267928960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788844780.863894:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844780.863914:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267929088 00000100:00100000:2.0:1788844780.863917:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267929088 00000100:00100000:2.0:1788844780.863942:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788844780.863948:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14381:x1875739267929088:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788844780.865484:0:14380:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788844780.865702:0:14380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 495144164601ns, next at 0ns, rc = 0 00000100:00080000:3.0:1788844780.869663:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788844780.871261:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267928960 00000100:00100000:1.0:1788844780.871277:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267928960 00000100:00100000:1.0:1788844780.871331:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788844780.871342:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875739267928960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788844780.871383:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788844780.871474:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875739267928960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (7577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844780.871481:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788844780.871603:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edc24fc000 x1875739267928960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788844780.871649:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267928960:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1788844780.874512:0:15043:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788844780.874524:0:15043:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788844780.874528:0:15043:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788844780.886382:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.886395:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da42b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.886413:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.886418:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.886424:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.886443:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.886455:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.886471:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.886500:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788844780.886607:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844780.886623:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.886656:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65e00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844780.886663:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.886675:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da42b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.886779:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da42b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.886789:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da42b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.886821:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844780.886823:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844780.886825:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.888356:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.888367:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fab45b38/0x7f1093851e2da432 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.888383:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.888386:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.888391:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fab45b38/0x7f1093851e2da432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.888405:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fab45b38/0x7f1093851e2da432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.888414:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fab45b38/0x7f1093851e2da432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.888422:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fab45b38/0x7f1093851e2da432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.888442:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788844780.888963:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.888970:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004648b9dc/0x7f1093851e2da439 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.888986:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.888989:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.888994:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004648b9dc/0x7f1093851e2da439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889004:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004648b9dc/0x7f1093851e2da439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889013:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004648b9dc/0x7f1093851e2da439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889020:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004648b9dc/0x7f1093851e2da439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889048:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788844780.889064:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788844780.889072:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fab45b38/0x7f1093851e2da432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889080:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64a00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.889086:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fab45b38/0x7f1093851e2da432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889096:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fab45b38/0x7f1093851e2da432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889138:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fab45b38/0x7f1093851e2da432 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889146:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fab45b38/0x7f1093851e2da432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889165:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844780.889169:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004648b9dc/0x7f1093851e2da439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889176:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65800 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.889179:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004648b9dc/0x7f1093851e2da439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889187:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004648b9dc/0x7f1093851e2da439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889199:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004648b9dc/0x7f1093851e2da439 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889207:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004648b9dc/0x7f1093851e2da439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889220:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.889222:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.889229:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.889678:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.889685:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004190336c/0x7f1093851e2da440 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889695:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.889698:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.889702:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004190336c/0x7f1093851e2da440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889710:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004190336c/0x7f1093851e2da440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889717:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004190336c/0x7f1093851e2da440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889724:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004190336c/0x7f1093851e2da440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889739:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844780.889748:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844780.889752:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004190336c/0x7f1093851e2da440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889758:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64e00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.889762:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004190336c/0x7f1093851e2da440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889782:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004190336c/0x7f1093851e2da440 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889792:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004190336c/0x7f1093851e2da440 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889798:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004190336c/0x7f1093851e2da440 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.889810:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.889811:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.889813:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844780.891932:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.898074:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.899056:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe01267/0x7f1093851e2da447 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.899079:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.899219:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.899228:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe01267/0x7f1093851e2da447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.899244:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fe01267/0x7f1093851e2da447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.899256:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe01267/0x7f1093851e2da447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.899278:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fe01267/0x7f1093851e2da447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.899320:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844780.899342:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844780.899348:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fe01267/0x7f1093851e2da447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.899356:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65400 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.899360:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe01267/0x7f1093851e2da447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.899370:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe01267/0x7f1093851e2da447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.899386:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fe01267/0x7f1093851e2da447 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.899393:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fe01267/0x7f1093851e2da447 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.899418:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.899420:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.899422:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.905732:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.905757:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076e2d50d/0x7f1093851e2da44e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.905774:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.905778:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.905785:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e2d50d/0x7f1093851e2da44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.905798:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076e2d50d/0x7f1093851e2da44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.905807:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076e2d50d/0x7f1093851e2da44e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.905814:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076e2d50d/0x7f1093851e2da44e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.905837:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844780.905848:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844780.905854:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076e2d50d/0x7f1093851e2da44e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.905861:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.905866:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076e2d50d/0x7f1093851e2da44e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.905874:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076e2d50d/0x7f1093851e2da44e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.905897:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076e2d50d/0x7f1093851e2da44e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.905904:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076e2d50d/0x7f1093851e2da44e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.905921:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.905923:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.905924:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.906402:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.906409:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e07e564/0x7f1093851e2da455 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.906418:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.906421:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.906426:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e07e564/0x7f1093851e2da455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.906436:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e07e564/0x7f1093851e2da455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.906445:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e07e564/0x7f1093851e2da455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.906452:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e07e564/0x7f1093851e2da455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.906480:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844780.906489:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844780.906493:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e07e564/0x7f1093851e2da455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.906499:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65c00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.906503:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e07e564/0x7f1093851e2da455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.906510:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e07e564/0x7f1093851e2da455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.906520:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e07e564/0x7f1093851e2da455 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.906528:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e07e564/0x7f1093851e2da455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.906568:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.906570:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.906572:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.912060:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.912074:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a2c7101/0x7f1093851e2da45c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.913655:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.913668:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.913676:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a2c7101/0x7f1093851e2da45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.913693:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a2c7101/0x7f1093851e2da45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.913706:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a2c7101/0x7f1093851e2da45c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.913713:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a2c7101/0x7f1093851e2da45c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.913737:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788844780.913894:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844780.913975:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a2c7101/0x7f1093851e2da45c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.913990:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64400 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844780.913997:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a2c7101/0x7f1093851e2da45c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.914010:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a2c7101/0x7f1093851e2da45c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.914054:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a2c7101/0x7f1093851e2da45c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.914062:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a2c7101/0x7f1093851e2da45c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.914094:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844780.914097:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844780.914099:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.916259:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.916274:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2da463 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.916290:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.916294:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.916300:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2da463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.916313:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2da463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.916323:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2da463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.916337:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2da463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.916363:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788844780.916409:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844780.916423:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2da463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.916438:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65a00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844780.916445:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2da463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.916456:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2da463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.916481:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2da463 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.916489:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c69650/0x7f1093851e2da463 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.916568:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844780.916571:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844780.916573:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788844780.917622:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788844780.918913:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.918925:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad77d93b/0x7f1093851e2da46a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.918942:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.918946:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.918951:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad77d93b/0x7f1093851e2da46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.918964:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad77d93b/0x7f1093851e2da46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.918973:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad77d93b/0x7f1093851e2da46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.918980:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad77d93b/0x7f1093851e2da46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.919013:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844780.919699:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844780.919708:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad77d93b/0x7f1093851e2da46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.919718:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844780.919724:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad77d93b/0x7f1093851e2da46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.919734:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad77d93b/0x7f1093851e2da46a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.919755:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad77d93b/0x7f1093851e2da46a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.919763:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad77d93b/0x7f1093851e2da46a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.919784:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844780.919786:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844780.919788:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.920215:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.920222:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da471 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.920237:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.920241:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.920245:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.920255:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.920263:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.920271:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.920297:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844780.920490:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844780.920603:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.920623:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844780.920627:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.920635:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.920647:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da471 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.920653:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005216162d/0x7f1093851e2da471 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.920668:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844780.920670:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844780.920672:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.921000:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.921007:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da478 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.921015:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.921019:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.921023:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.921033:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.921338:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da478 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.921347:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.921373:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844780.921598:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844780.921666:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.921675:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d65e00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844780.921679:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da478 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.921699:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da478 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.921711:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da478 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.921718:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ae99a5/0x7f1093851e2da478 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.921735:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844780.921737:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844780.921739:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.922278:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.922285:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000447f9876/0x7f1093851e2da47f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.922294:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.922297:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.922301:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000447f9876/0x7f1093851e2da47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.922311:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000447f9876/0x7f1093851e2da47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.922318:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000447f9876/0x7f1093851e2da47f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.922324:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000447f9876/0x7f1093851e2da47f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.922350:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844780.927041:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844780.927056:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000447f9876/0x7f1093851e2da47f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.927070:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844780.927075:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000447f9876/0x7f1093851e2da47f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.927088:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000447f9876/0x7f1093851e2da47f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.927131:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000447f9876/0x7f1093851e2da47f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.927151:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000447f9876/0x7f1093851e2da47f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.927175:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844780.927177:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844780.927179:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.927405:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.927413:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da486 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.927427:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.927431:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.927438:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.927450:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.927460:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da486 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.927468:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.927493:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844780.927774:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844780.927780:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.927789:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d800 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844780.927793:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da486 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.927803:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da486 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.927815:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da486 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.927823:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da486 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844780.927839:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844780.927841:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844780.927843:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844780.929015:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.929026:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025832ed7/0x7f1093851e2da48d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.929038:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.929048:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.929054:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025832ed7/0x7f1093851e2da48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.929066:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025832ed7/0x7f1093851e2da48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.929074:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025832ed7/0x7f1093851e2da48d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.929081:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025832ed7/0x7f1093851e2da48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.929227:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788844780.929955:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.929963:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fa5e3a/0x7f1093851e2da494 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.929974:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.929977:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.929982:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012fa5e3a/0x7f1093851e2da494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.929992:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012fa5e3a/0x7f1093851e2da494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.930001:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012fa5e3a/0x7f1093851e2da494 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.930016:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012fa5e3a/0x7f1093851e2da494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.930040:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788844780.930763:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.930771:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6212f44/0x7f1093851e2da49b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.930781:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.930785:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.930789:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6212f44/0x7f1093851e2da49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.930798:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6212f44/0x7f1093851e2da49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.930805:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6212f44/0x7f1093851e2da49b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.930811:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6212f44/0x7f1093851e2da49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.930818:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788844780.931348:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.931355:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1d815e9/0x7f1093851e2da4a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.931368:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.931372:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844780.931377:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d815e9/0x7f1093851e2da4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.931387:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1d815e9/0x7f1093851e2da4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.931395:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1d815e9/0x7f1093851e2da4a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.931403:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1d815e9/0x7f1093851e2da4a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.931411:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788844780.931763:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788844780.931773:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025832ed7/0x7f1093851e2da48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.931783:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170c000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844780.931788:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025832ed7/0x7f1093851e2da48d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.931798:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025832ed7/0x7f1093851e2da48d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.931818:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025832ed7/0x7f1093851e2da48d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.931826:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025832ed7/0x7f1093851e2da48d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.931846:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788844780.931850:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012fa5e3a/0x7f1093851e2da494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.931856:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170dc00 already unused, calling callback (ffffffffc1784420) 00002000:00010000:2.0:1788844780.932015:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844780.932020:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ba16de3/0x7f1093851e2da4a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932032:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fa5e3a/0x7f1093851e2da494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.932035:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=495s v=(0 0) 00010000:00010000:2.0:1788844780.932044:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844780.932050:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012fa5e3a/0x7f1093851e2da494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.932051:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ba16de3/0x7f1093851e2da4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.932075:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ba16de3/0x7f1093851e2da4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932078:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012fa5e3a/0x7f1093851e2da494 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932087:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012fa5e3a/0x7f1093851e2da494 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932101:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788844780.932104:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6212f44/0x7f1093851e2da49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932111:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170c200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844780.932114:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6212f44/0x7f1093851e2da49b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932134:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6212f44/0x7f1093851e2da49b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932143:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6212f44/0x7f1093851e2da49b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932150:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6212f44/0x7f1093851e2da49b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932171:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844780.932174:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1d815e9/0x7f1093851e2da4a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932180:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170c600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844780.932183:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1d815e9/0x7f1093851e2da4a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932190:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1d815e9/0x7f1093851e2da4a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932199:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1d815e9/0x7f1093851e2da4a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932206:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1d815e9/0x7f1093851e2da4a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.932216:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844780.932218:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844780.932219:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844780.932704:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.936177:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ba16de3/0x7f1093851e2da4a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.936186:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ba16de3/0x7f1093851e2da4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.936265:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788844780.937227:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788844780.937235:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da4b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.937249:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788844780.937259:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844780.937266:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.937280:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.937288:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da4b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.937296:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da4b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.938413:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788844780.938968:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788844780.938975:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdaf6273/0x7f1093851e2da4b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.938990:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788844780.938993:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844780.938998:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdaf6273/0x7f1093851e2da4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.939010:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdaf6273/0x7f1093851e2da4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.939019:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdaf6273/0x7f1093851e2da4b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.939033:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdaf6273/0x7f1093851e2da4b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.942187:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788844780.942204:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ba16de3/0x7f1093851e2da4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.942218:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170cc00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844780.942224:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ba16de3/0x7f1093851e2da4a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.942235:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ba16de3/0x7f1093851e2da4a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.942266:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ba16de3/0x7f1093851e2da4a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.942275:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ba16de3/0x7f1093851e2da4a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.942301:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788844780.942306:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da4b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.942312:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025a00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844780.942315:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da4b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.942322:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da4b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.942344:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da4b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.942349:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844780.942352:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da4b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.942370:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844780.942371:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844780.942373:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.942527:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.942766:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdaf6273/0x7f1093851e2da4b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.942776:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024a00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.942780:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdaf6273/0x7f1093851e2da4b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.942789:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdaf6273/0x7f1093851e2da4b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.942800:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdaf6273/0x7f1093851e2da4b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.942809:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.942810:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.942812:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.942817:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.942826:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844780.944260:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788844780.944272:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdaf6273/0x7f1093851e2da4b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788844780.946322:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788844780.946334:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1159987/0x7f1093851e2da4be lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.946351:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788844780.946356:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844780.946363:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1159987/0x7f1093851e2da4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.946376:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1159987/0x7f1093851e2da4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.946386:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1159987/0x7f1093851e2da4be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.946394:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1159987/0x7f1093851e2da4be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.946435:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844780.946755:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844780.946763:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1159987/0x7f1093851e2da4be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.946773:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025e00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.946777:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1159987/0x7f1093851e2da4be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.946786:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1159987/0x7f1093851e2da4be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.946804:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1159987/0x7f1093851e2da4be lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.946811:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1159987/0x7f1093851e2da4be lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.946833:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.946836:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.946839:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844780.946839:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788844780.948474:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788844780.948490:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da4c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.948514:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788844780.948518:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844780.948523:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.948553:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.948563:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da4c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.948571:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.948595:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844780.948695:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844780.948704:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.948713:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.948965:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da4c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.948988:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da4c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.949004:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da4c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.949012:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da4c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.949035:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.949037:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.949040:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788844780.949094:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788844780.949100:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041945fcf/0x7f1093851e2da4cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.949109:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788844780.949137:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844780.949142:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041945fcf/0x7f1093851e2da4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.949153:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041945fcf/0x7f1093851e2da4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.949160:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041945fcf/0x7f1093851e2da4cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.949168:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041945fcf/0x7f1093851e2da4cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.955826:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788844780.956703:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844780.956714:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041945fcf/0x7f1093851e2da4cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.956728:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024c00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844780.956733:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041945fcf/0x7f1093851e2da4cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.956744:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041945fcf/0x7f1093851e2da4cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.956765:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041945fcf/0x7f1093851e2da4cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.956772:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041945fcf/0x7f1093851e2da4cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.956803:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844780.956805:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844780.956807:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788844780.957742:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788844780.957754:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056aceaf0/0x7f1093851e2da4d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.957768:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788844780.957773:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844780.957778:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056aceaf0/0x7f1093851e2da4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.957791:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056aceaf0/0x7f1093851e2da4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.957801:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056aceaf0/0x7f1093851e2da4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.957817:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056aceaf0/0x7f1093851e2da4d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.957841:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844780.957855:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844780.957863:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056aceaf0/0x7f1093851e2da4d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.957872:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024800 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.957876:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056aceaf0/0x7f1093851e2da4d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.957886:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056aceaf0/0x7f1093851e2da4d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.957898:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056aceaf0/0x7f1093851e2da4d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.957917:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.957918:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.957920:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844780.957978:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056aceaf0/0x7f1093851e2da4d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788844780.962168:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788844780.962185:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050073eca/0x7f1093851e2da4da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.962202:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788844780.962207:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844780.962212:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050073eca/0x7f1093851e2da4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.962225:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050073eca/0x7f1093851e2da4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.962236:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050073eca/0x7f1093851e2da4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.962244:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050073eca/0x7f1093851e2da4da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.962290:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844780.962305:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844780.962313:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050073eca/0x7f1093851e2da4da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.962323:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844780.962328:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050073eca/0x7f1093851e2da4da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.962338:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050073eca/0x7f1093851e2da4da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.962356:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050073eca/0x7f1093851e2da4da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.962364:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050073eca/0x7f1093851e2da4da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844780.962390:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.962393:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844780.962396:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788844780.962931:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788844780.962937:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2da4e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.962946:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788844780.962949:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844780.962954:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2da4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.962963:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2da4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.962970:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2da4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.962977:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2da4e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844780.963001:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788844780.963193:0:15043:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1788844780.963295:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14381:x1875739267929088:12345-0@lo:5:osp-pre-0-0.0 Request processed in 99343us (99443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844780.963310:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788844780.963320:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1875739267929088:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788844780.963337:0:14381:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788844780.963384:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1875739267929216:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788844780.963418:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844780.963459:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed85870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844780.963486:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267929216 00000100:00100000:2.0:1788844780.963492:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267929216 00000100:00100000:2.0:1788844780.963529:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788844780.964217:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14381:x1875739267929216:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788844780.964265:0:15045:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1788844780.967704:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844780.967719:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2da4e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.967732:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844780.967737:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2da4e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.967747:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2da4e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.967768:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2da4e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.967775:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f496aa8/0x7f1093851e2da4e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844780.967795:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844780.967797:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844780.967800:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844780.980779:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14381:x1875739267929216:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17234us (17352us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788844780.980794:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788844780.980975:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1875739267929216:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788844780.980991:0:14381:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1788844780.987052:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844782.010014:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788844782.526899:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788844782.526956:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788844783.034728:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844784.063319:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844785.087847:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844785.916486:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788844785.916519:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267929344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844785.916613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788844785.916728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788844785.916732:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788844785.916735:0:37:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788844785.916741:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1788844785.916746:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788844785.916753:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eec3808800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1788844785.916772:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc12f0700 x1875739267929600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788844785.916811:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:661a174e-3914-46cb-b31b-f72a0fba243b:3305:1875739267929472:0@lo:400:kworker.0 00000100:00100000:1.0:1788844785.916840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844785.916863:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844785.916868:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267929728:0@lo:400:kworker.0 00000100:00100000:1.0:1788844785.916889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844785.916911:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267929600:0@lo:8:kworker.0 00000100:00100000:1.0:1788844785.916935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844785.916961:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267929472 00000100:00100000:1.0:1788844785.916968:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267929472 00000100:00100000:1.0:1788844785.917010:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788844785.917017:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+16:3305:x1875739267929472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844785.917078:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+16:3305:x1875739267929472:12345-0@lo:400:kworker.0 Request processed in 60us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844785.917085:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788844785.917117:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267929728 00000100:00100000:1.0:1788844785.917127:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267929728 00000100:00100000:1.0:1788844785.917153:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788844785.917159:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267929728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844785.917190:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267929728:12345-0@lo:400:kworker.0 Request processed in 31us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844785.917196:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788844785.917230:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edc12f1500 x1875739267929728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844785.917243:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267929728:0@lo:400:kworker.0 00000100:00100000:1.0:1788844785.917251:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:661a174e-3914-46cb-b31b-f72a0fba243b:3305:1875739267929472:0@lo:400:kworker.0 00000100:00100000:1.0:1788844785.917276:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267929856:0@lo:400:kworker.0 00000100:00100000:1.0:1788844785.917298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844785.917325:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267929856 00000100:00100000:1.0:1788844785.917329:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267929856 00000100:00100000:1.0:1788844785.917359:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788844785.917365:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267929856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844785.917396:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267929856:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844785.917401:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788844785.917426:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edc12f1c00 x1875739267929856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844785.917435:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267929856:0@lo:400:kworker.0 00000100:00100000:3.0:1788844785.918197:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267929344 00000100:00100000:3.0:1788844785.918212:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267929344 00000100:00100000:3.0:1788844785.918255:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788844785.918263:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267929344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844785.918292:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844785.918344:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267929344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844785.918351:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788844785.918371:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267929600 00000100:00100000:3.0:1788844785.918375:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267929600 00000100:00100000:3.0:1788844785.918393:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788844785.918398:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875739267929600:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788844785.918412:0:15043:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788844785.918594:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788844785.918615:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844785.919983:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788844785.920016:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267929344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844785.950408:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875739267929600:12345-0@lo:8:kworker.0 Request processed in 31985us (33448us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788844785.950422:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788844785.951262:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788844785.951269:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788844785.951289:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267929600:0@lo:8:kworker.0 00010000:00010000:2.0:1788844786.105704:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844787.130102:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788844787.514227:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788844788.106257:0:15763:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788844788.106261:0:15763:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788844788.106405:0:15763:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91eef3795000 00000020:01000004:3.0:1788844788.106422:0:15763:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788844788.106436:0:15763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788844788.117011:0:15763:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91eec2de8000) 00000020:00000080:0.0:1788844788.118883:0:15763:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788844788.145239:0:15763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788844788.145460:0:15763:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788844788.146826:0:15763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788844788.147149:0:15763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788844788.147350:0:15763:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788844788.148189:0:15763:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 547: rc = 0 00100000:10000000:0.0:1788844788.148288:0:15763:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 547: rc = 0 00100000:10000000:0.0:1788844788.148387:0:15763:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 547: rc = 0 00100000:10000000:0.0:1788844788.149196:0:15763:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 637: rc = 0 00100000:10000000:0.0:1788844788.149791:0:15763:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 637: rc = 0 00100000:10000000:0.0:1788844788.150143:0:15763:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 637: rc = 0 00100000:10000000:0.0:1788844788.150397:0:15763:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 637: rc = 0 00100000:10000000:0.0:1788844788.150956:0:15763:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 637: rc = 0 00100000:10000000:0.0:1788844788.151224:0:15763:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 637: rc = 0 00000020:00000080:0.0:1788844788.153061:0:15763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788844788.153075:0:15763:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788844788.153086:0:15763:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7f1093851e2da4ef 00000020:01000004:0.0:1788844788.153095:0:15763:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788844788.153127:0:15763:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.143@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788844788.153131:0:15763:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788844788.153137:0:15763:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788844788.153160:0:15763:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788844788.153164:0:15763:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:1.0:1788844788.155650:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788844788.168161:0:15763:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.143@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788844788.168215:0:15763:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.143@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788844788.168219:0:15763:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788844788.168221:0:15763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788844788.168222:0:15763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844788.168223:0:15763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844788.168224:0:15763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844788.168226:0:15763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844788.168227:0:15763:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788844788.168230:0:15763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844788.168231:0:15763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788844788.168235:0:15763:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788844788.168237:0:15763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788844788.168238:0:15763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788844788.168240:0:15763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844788.168241:0:15763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844788.168242:0:15763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844788.168243:0:15763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844788.168244:0:15763:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788844788.168245:0:15763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844788.168246:0:15763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788844788.168273:0:15763:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788844788.168295:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267929984:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788844788.168370:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844788.169098:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788844788.169221:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267929984 00000100:00100000:2.0:1788844788.169229:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267929984 00000100:00100000:2.0:1788844788.169288:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788844788.169298:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+16:15763:x1875739267929984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788844788.169331:0:14353:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788844788.169335:0:14353:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788844788.169338:0:14353:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788844788.180794:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+16:15763:x1875739267929984:12345-0@lo:253:mount.lustre.0 Request processed in 11488us (12414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844788.180809:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788844788.180970:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267929984:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788844788.180996:0:15763:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788844788.181000:0:15763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788844788.181002:0:15763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788844788.181009:0:15763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788844788.181011:0:15763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788844788.181012:0:15763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788844788.181013:0:15763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788844788.181015:0:15763:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788844788.181016:0:15763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788844788.181018:0:15763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788844788.181039:0:15763:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91eef3795000 from lustre-OST0001 10000000:01000000:0.0:1788844788.181071:0:15763:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788844788.181074:0:15763:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788844788.181082:0:15763:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91eec2de99b8 local copy 00010000:00010000:0.0:1788844788.181093:0:15763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2a3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844788.181316:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788844788.181353:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844788.181433:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844788.181647:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267930112 00000100:00100000:1.0:1788844788.181654:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267930112 00000100:00100000:1.0:1788844788.181699:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788844788.181708:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+16:15763:x1875739267930112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788844788.182127:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+16:15763:x1875739267930112:12345-0@lo:501:mount.lustre.0 Request processed in 418us (772us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788844788.182135:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788844788.182228:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930112:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788844788.182243:0:15763:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788844788.182408:0:15763:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788844788.182415:0:15763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2a3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844788.182425:0:15763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0025000/0x7f1093851e2da29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da2a3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788844788.182456:0:15763:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91eef3795000 10000000:01000000:3.0:1788844788.182460:0:15763:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788844788.182465:0:15763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788844788.182566:0:15763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788844788.182571:0:15763:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788844788.182574:0:15763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788844788.182600:0:15763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2da4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844788.182608:0:15763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2da4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844788.182617:0:15763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2da4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844788.182633:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788844788.182665:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844788.182750:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788844788.183010:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267930240 00000100:00100000:2.0:1788844788.183018:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267930240 00000100:00100000:2.0:1788844788.183095:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788844788.183104:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+16:15763:x1875739267930240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788844788.183114:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844788.183128:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ef0170da00/0x7f1093851e2da4fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da4f6 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.183150:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0170da00/0x7f1093851e2da4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da4f6 expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.183160:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ef0170da00/0x7f1093851e2da4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da4f6 expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.183169:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0170da00, rc 0) 00000100:00100000:2.0:1788844788.183212:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+17:15763:x1875739267930240:12345-0@lo:101:mount.lustre.0 Request processed in 109us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844788.183218:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788844788.183287:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844788.183300:0:15763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2da4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da4fd expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844788.183310:0:15763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2da4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da4fd expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788844788.184372:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788844788.186972:0:15763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788844788.187266:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788844788.187317:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788844788.187354:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788844788.187402:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788844788.187456:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788844788.187507:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788844788.187797:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788844788.187806:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788844788.187996:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788844788.188071:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844788.188111:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844788.188255:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267930368 00000100:00100000:2.0:1788844788.188263:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267930368 00000100:00100000:2.0:1788844788.188319:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788844788.188329:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+17:15763:x1875739267930368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788844788.188778:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+17:15763:x1875739267930368:12345-0@lo:501:mount.lustre.0 Request processed in 450us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844788.188787:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788844788.189342:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788844788.189387:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930496:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788844788.189439:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844788.189462:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844788.189779:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267930496 00000100:00100000:2.0:1788844788.189785:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267930496 00000100:00100000:2.0:1788844788.189826:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788844788.189833:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+17:15763:x1875739267930496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788844788.190295:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+17:15763:x1875739267930496:12345-0@lo:503:mount.lustre.0 Request processed in 461us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844788.190304:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788844788.190640:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930496:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788844788.191285:0:15763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788844788.191353:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788844788.191397:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844788.191486:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844788.191708:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267930624 00000100:00100000:3.0:1788844788.191771:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267930624 00000100:00100000:3.0:1788844788.191948:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788844788.191958:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+17:15763:x1875739267930624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788844788.192238:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+17:15763:x1875739267930624:12345-0@lo:502:mount.lustre.0 Request processed in 281us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844788.192245:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788844788.192328:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788844788.192863:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788844788.193002:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788844788.193036:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788844788.193088:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788844788.193123:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788844788.193154:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788844788.193215:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788844788.193255:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788844788.193303:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788844788.193341:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788844788.193394:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844788.193496:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844788.194064:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267930752 00000100:00100000:3.0:1788844788.194073:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267930752 00000100:00100000:3.0:1788844788.194157:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788844788.194166:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+17:15763:x1875739267930752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788844788.194367:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+17:15763:x1875739267930752:12345-0@lo:502:mount.lustre.0 Request processed in 201us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844788.194375:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788844788.194478:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788844788.194580:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788844788.194593:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788844788.195958:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788844788.195969:0:15764:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788844788.195986:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844788.195989:0:15764:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788844788.195996:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788844788.196014:0:15764:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91ef01bf4d28) 00000020:00000080:3.0:1788844788.196043:0:15764:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788844788.196049:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788844788.196128:0:15764:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eef3795000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788844788.196137:0:15764:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788844788.196144:0:15764:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7f1093851e2da50b 00010000:00010000:1.0:1788844788.208066:0:15764:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788844788.209073:0:15764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788844788.214448:0:15764:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788844788.217205:0:15764:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788844788.217219:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844788.217227:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844788.217229:0:15764:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788844788.217233:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844788.217237:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844788.217238:0:15764:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788844788.217241:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788844788.217243:0:15764:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788844788.217245:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844788.217248:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844788.217249:0:15764:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788844788.217251:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788844788.217261:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844788.217262:0:15764:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788844788.217266:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788844788.217326:0:15764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788844788.217330:0:15764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788844788.217331:0:15764:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788844788.217335:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788844788.217505:0:15763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788844788.217533:0:15763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788844788.217582:0:15763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2da4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da4fd expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.217593:0:15763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0024a00/0x7f1093851e2da4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da4fd expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844788.217601:0:15763:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eef3795000 from 1 10000000:01000000:2.0:1788844788.217605:0:15763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788844788.217644:0:15763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.217652:0:15763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.217663:0:15763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844788.217687:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788844788.217767:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844788.217808:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cf0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788844788.218000:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267930880 00000100:00100000:1.0:1788844788.218008:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267930880 00000100:00100000:1.0:1788844788.218057:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788844788.218067:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+17:15763:x1875739267930880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788844788.218081:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844788.218094:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed0d60000/0x7f1093851e2da519 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da512 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844788.218117:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d60000/0x7f1093851e2da519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da512 expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844788.218127:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed0d60000/0x7f1093851e2da519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da512 expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844788.218135:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60000, rc 0) 00000100:00100000:1.0:1788844788.218177:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267930880:12345-0@lo:101:mount.lustre.0 Request processed in 111us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844788.218183:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788844788.218376:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267930880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788844788.218390:0:15763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.218412:0:15763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788844788.218968:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788844788.219349:0:15763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788844788.219613:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788844788.219655:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788844788.219736:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788844788.219745:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788844788.219804:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788844788.219850:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844788.220168:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4cf0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788844788.224240:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267931008 00000100:00100000:1.0:1788844788.224257:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267931008 00000100:00100000:1.0:1788844788.224324:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788844788.224336:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267931008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788844788.225052:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267931008:12345-0@lo:501:mount.lustre.0 Request processed in 715us (5197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844788.225068:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788844788.226924:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788844788.227016:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931136:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788844788.227098:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844788.229683:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788844788.229939:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267931136 00000100:00100000:0.0:1788844788.229949:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267931136 00000100:00100000:0.0:1788844788.230011:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788844788.230020:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267931136:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788844788.230298:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267931136:12345-0@lo:503:mount.lustre.0 Request processed in 279us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844788.230306:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788844788.230449:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931136:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788844788.231315:0:15763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788844788.231384:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788844788.231433:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844788.231462:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788844788.231571:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267931264 00000100:00100000:0.0:1788844788.231577:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267931264 00000100:00100000:0.0:1788844788.231604:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788844788.231611:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267931264:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788844788.231788:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267931264:12345-0@lo:502:mount.lustre.0 Request processed in 177us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844788.231796:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788844788.231840:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788844788.232272:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788844788.232336:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788844788.232384:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788844788.232422:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788844788.232454:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788844788.232498:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788844788.232531:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788844788.232597:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788844788.232629:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788844788.232674:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844788.232699:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788844788.232992:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267931392 00000100:00100000:3.0:1788844788.232999:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267931392 00000100:00100000:3.0:1788844788.233036:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788844788.233043:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267931392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788844788.233192:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267931392:12345-0@lo:502:mount.lustre.0 Request processed in 148us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844788.233199:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788844788.234662:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788844788.235053:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788844788.235067:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788844788.236839:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844788.236853:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844788.236856:0:15768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788844788.236941:0:15768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eef3795000 00000020:00000080:3.0:1788844788.236947:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788844788.236955:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844788.236958:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844788.236959:0:15768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788844788.236962:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844788.236964:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844788.236965:0:15768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788844788.236969:0:15768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91eef3795000 00000020:00000080:3.0:1788844788.236970:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788844788.237027:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844788.237030:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844788.237031:0:15768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788844788.237034:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788844788.237036:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844788.237037:0:15768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788844788.237048:0:15768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91eef3795000 00000020:00000080:3.0:1788844788.237050:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788844788.237089:0:15768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788844788.237094:0:15768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788844788.237095:0:15768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788844788.237098:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788844788.237239:0:15763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788844788.237266:0:15763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788844788.237291:0:15763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844788.237302:0:15763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788844788.237353:0:15763:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788844788.237356:0:15763:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91eef3795000 10000000:01000000:0.0:1788844788.237359:0:15763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91eef3795000 10000000:01000000:0.0:1788844788.237364:0:15763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788844788.237369:0:15763:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91eef3795000 from 1 10000000:01000000:0.0:1788844788.237371:0:15763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788844788.237408:0:15763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844788.237416:0:15763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844788.237426:0:15763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844788.237449:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788844788.238686:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844788.238833:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788844788.239424:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267931520 00000100:00100000:3.0:1788844788.239435:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267931520 00000100:00100000:3.0:1788844788.239501:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788844788.239510:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267931520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788844788.239525:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844788.239568:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0024800/0x7f1093851e2da527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da520 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844788.239597:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024800/0x7f1093851e2da527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da520 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844788.239609:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0024800/0x7f1093851e2da527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da520 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844788.239617:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024800, rc 0) 00000100:00100000:3.0:1788844788.239672:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:15763:x1875739267931520:12345-0@lo:101:mount.lustre.0 Request processed in 163us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844788.239678:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788844788.241703:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788844788.241743:0:15763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da527 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844788.241755:0:15763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da527 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788844788.242504:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788844788.244338:0:15763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788844788.244628:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788844788.244673:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788844788.244710:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788844788.250824:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788844788.251019:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788844788.251085:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788844788.251120:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788844788.251169:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788844788.251214:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788844788.251248:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788844788.251280:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788844788.251326:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788844788.251362:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788844788.251397:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788844788.251444:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788844788.251481:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788844788.251512:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788844788.251607:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788844788.251643:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788844788.251675:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788844788.254003:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788844788.254088:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788844788.254124:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788844788.254174:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788844788.254212:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788844788.254245:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788844788.254292:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788844788.254330:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788844788.254365:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788844788.254416:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788844788.254455:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788844788.255633:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788844788.255677:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788844788.256645:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788844788.256697:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788844788.257641:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788844788.257687:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788844788.258032:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788844788.258042:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788844788.258140:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788844788.262205:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844788.262254:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eede895c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788844788.264598:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267931648 00000100:00100000:3.0:1788844788.264612:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267931648 00000100:00100000:3.0:1788844788.264671:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788844788.264682:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb6a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:15763:x1875739267931648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788844788.267431:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb6a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:15763:x1875739267931648:12345-0@lo:501:mount.lustre.0 Request processed in 2741us (5223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844788.267451:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788844788.267831:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788844788.267886:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788844788.267938:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844788.267968:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eede895c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788844788.268583:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267931776 00000100:00100000:2.0:1788844788.268591:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267931776 00000100:00100000:2.0:1788844788.268642:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788844788.268651:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eee14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+20:15763:x1875739267931776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788844788.268911:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eee14c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+20:15763:x1875739267931776:12345-0@lo:503:mount.lustre.0 Request processed in 260us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844788.268918:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788844788.269843:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931776:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788844788.270618:0:15763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788844788.270695:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788844788.270766:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844788.270803:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59df840 going to sleep for 11 seconds 00000100:00100000:3.0:1788844788.273225:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267931904 00000100:00100000:3.0:1788844788.273242:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267931904 00000100:00100000:3.0:1788844788.273298:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788844788.273309:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eee14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+19:15763:x1875739267931904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788844788.273722:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eee14c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+19:15763:x1875739267931904:12345-0@lo:502:mount.lustre.0 Request processed in 414us (2954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844788.273731:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788844788.274008:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267931904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788844788.277179:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788844788.277270:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788844788.277308:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788844788.277370:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788844788.277411:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788844788.277459:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788844788.278633:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788844788.278669:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788844788.278727:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788844788.278757:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788844788.278781:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788844788.278825:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788844788.278855:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788844788.278896:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788844788.278940:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788844788.278990:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788844788.279024:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788844788.279072:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788844788.279106:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788844788.279136:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788844788.279180:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788844788.279216:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788844788.279248:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788844788.279296:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788844788.279333:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788844788.279366:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788844788.279416:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788844788.279453:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788844788.282697:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788844788.282797:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788844788.282833:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788844788.282868:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788844788.282917:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788844788.282967:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788844788.283017:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788844788.283065:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788844788.283101:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788844788.283134:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788844788.283181:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788844788.283218:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788844788.283268:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267932032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788844788.283347:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844788.283385:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59df840 going to sleep for 11 seconds 00000100:00100000:0.0:1788844788.283836:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267932032 00000100:00100000:0.0:1788844788.283844:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267932032 00000100:00100000:0.0:1788844788.283893:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788844788.283901:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:15763:x1875739267932032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788844788.284151:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:15763:x1875739267932032:12345-0@lo:502:mount.lustre.0 Request processed in 249us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844788.284158:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788844788.284402:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267932032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788844788.284505:0:15763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788844788.284517:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788844788.287170:0:15772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788844788.287187:0:15772:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91ef01bf3370) 00000020:00000080:3.0:1788844788.287209:0:15772:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788844788.287299:0:15772:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91eef3795000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788844788.287303:0:15772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91eef3795000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788844788.287305:0:15772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91eef3795000 3 00010000:00080000:3.0:1788844788.287347:0:15772:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91edc21b1000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.143@tcp at head 00010000:00010000:3.0:1788844788.288936:0:15772:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788844788.289154:0:15772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788844788.289187:0:15772:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788844788.289202:0:15772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7f1093851e2da535 00000100:00080000:3.0:1788844788.289212:0:15772:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788844788.289217:0:15772:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91edc21b1000 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:3.0:1788844788.289253:0:15772:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ef0170b800 x1875739267932160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788844788.289282:0:15772:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788844788.289426:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875739267932160:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788844788.289496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844788.289695:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267932160 00000100:00100000:0.0:1788844788.289702:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267932160 00000100:00100000:0.0:1788844788.289747:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788844788.289754:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875739267932160:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788844788.289776:0:14360:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1788844788.289808:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7f1093851e2da53c 00000004:00100000:0.0:1788844788.289822:0:14360:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788844788.289852:0:14360:0:(import.c:65:import_set_state_nolock()) ffff91edc2847000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844788.289916:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875739267932160:12345-0@lo:38:llog_process_th.0 Request processed in 161us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844788.289923:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788844788.289957:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ef0170b800 x1875739267932160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788844798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844788.289967:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788844788.289984:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788844788.289992:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788844788.289996:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788844788.289998:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91edc21b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788844788.290002:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875739267932160:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788844788.290143:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788844788.290891:0:15763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788844788.290919:0:15763:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788844788.290932:0:15763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da527 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.290943:0:15763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0031600/0x7f1093851e2da520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da527 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788844788.291002:0:15763:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788844788.291005:0:15763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788844788.291006:0:15763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788844788.291008:0:15763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788844788.291009:0:15763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788844788.291011:0:15763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788844788.291012:0:15763:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788844788.291014:0:15763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788844788.291015:0:15763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788844788.291018:0:15763:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788844788.291025:0:15763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788844788.291027:0:15763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788844788.291028:0:15763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788844788.291029:0:15763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788844788.291030:0:15763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788844788.291031:0:15763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788844788.291032:0:15763:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788844788.291033:0:15763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788844788.291034:0:15763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788844788.291054:0:15763:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788844788.291068:0:15763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267932288:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788844788.291127:0:15763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844788.291162:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267932288 00000100:00100000:2.0:1788844788.291167:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267932288 00000100:00100000:2.0:1788844788.291204:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788844788.291212:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:15763:x1875739267932288:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788844788.291234:0:14353:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788844788.291248:0:14353:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788844788.291683:0:15763:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec59df3c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788844788.291989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788844788.291994:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788844788.291997:0:37:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788844788.292009:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1788844788.292012:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788844788.292017:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eec3808800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:1.0:1788844788.292036:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edc12f1500 x1875739267932544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788844788.292098:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788844788.292107:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267932416:0@lo:400:kworker.0 00000100:00100000:1.0:1788844788.292147:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844788.292177:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267932544:0@lo:8:kworker.0 00000100:00100000:1.0:1788844788.292196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844788.292216:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267932672:0@lo:400:kworker.0 00000100:00100000:1.0:1788844788.292236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844788.292249:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788844788.292253:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc12f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267932800:0@lo:400:kworker.0 00000100:00100000:1.0:1788844788.292270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844788.292315:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267932416 00000100:00100000:1.0:1788844788.292320:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267932416 00000100:00100000:1.0:1788844788.292368:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267932544 00000100:00100000:1.0:1788844788.292371:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267932544 00000100:00100000:1.0:1788844788.292381:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788844788.292388:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267932416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844788.292429:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267932416:12345-0@lo:400:kworker.0 Request processed in 41us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844788.292435:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788844788.292448:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788844788.292452:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875739267932544:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788844788.292516:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875739267932544:12345-0@lo:8:kworker.0 Request processed in 62us (319us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788844788.292522:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788844788.292574:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267932672 00000100:00100000:1.0:1788844788.292578:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267932672 00000100:00100000:1.0:1788844788.292599:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267932800 00000100:00100000:1.0:1788844788.292602:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267932800 00000100:00100000:1.0:1788844788.292616:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788844788.292623:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267932672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844788.292657:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875739267932672:12345-0@lo:400:kworker.0 Request processed in 35us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844788.292664:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788844788.292674:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788844788.292681:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267932800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844788.292706:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875739267932800:12345-0@lo:400:kworker.0 Request processed in 26us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844788.292711:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788844788.293248:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788844788.293254:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788844788.293292:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267932416:0@lo:400:kworker.0 00000100:00100000:1.0:1788844788.293386:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788844788.293394:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788844788.293398:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788844788.293402:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267932544:0@lo:8:kworker.0 00010000:00080000:1.0:1788844788.293434:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edc12f0700 x1875739267932800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844788.293559:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875739267932800:0@lo:400:kworker.0 00010000:00080000:1.0:1788844788.293575:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edc12f2300 x1875739267932672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788844788.293584:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc12f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875739267932672:0@lo:400:kworker.0 20000000:01000000:3.0:1788844788.348935:0:14353:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788844788.348956:0:14353:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788844788.349070:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788844788.349075:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788844788.349097:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844788.349115:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed0d65200/0x7f1093851e2da41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da416 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844788.349141:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844788.349183:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed0d65200/0x7f1093851e2da41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2da416 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844788.349197:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eed0d65200/0x7f1093851e2da41d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2da416 expref: 19 pid: 14352 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844788.349212:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb068e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875739267932928:0@lo:104: 00000100:00100000:0.0:1788844788.349278:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844788.349622:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788844788.355740:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267932928 00000100:00100000:2.0:1788844788.355755:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267932928 00000100:00100000:2.0:1788844788.355938:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788844788.355950:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:661a174e-3914-46cb-b31b-f72a0fba243b+3:14374:x1875739267932928:12345-0@lo:104: 00010000:00010000:2.0:1788844788.355967:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356084:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788844788.356091:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:661a174e-3914-46cb-b31b-f72a0fba243b+3:14374:x1875739267932928:12345-0@lo:104: Request processed in 145us (6812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844788.356098:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788844788.356121:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844788.356142:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356149:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0030800 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844788.356153:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356161:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844788.356168:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844788.356173:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788844788.356209:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356216:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844788.356236:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356242:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eec0030800/0x7f1093851e2da416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da41d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356259:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844788.356261:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844788.356263:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844788.356271:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788844788.356286:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267933056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788844788.356338:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844788.356380:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267933056 00000100:00100000:2.0:1788844788.356391:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267933056 00010000:00010000:2.0:1788844788.356411:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed0d65200/0x7f1093851e2da41d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da416 expref: 20 pid: 14352 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844788.356432:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788844788.356437:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:661a174e-3914-46cb-b31b-f72a0fba243b+20:3308:x1875739267933056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788844788.356448:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844788.356454:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed0d65200/0x7f1093851e2da41d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da416 expref: 20 pid: 14352 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356476:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed0d65200/0x7f1093851e2da41d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2da416 expref: 20 pid: 14352 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356496:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356505:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788844788.356520:0:14345:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007445224s 00010000:00010000:2.0:1788844788.356525:0:14345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356533:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356573:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356580:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356596:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0031800 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844788.356600:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356609:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356618:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844788.356629:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844788.356658:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:661a174e-3914-46cb-b31b-f72a0fba243b+20:3308:x1875739267933056:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844788.356665:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788844788.356699:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267933056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788844788.357169:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed0d65200/0x7f1093851e2da41d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2da416 expref: 19 pid: 14352 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844788.357183:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb068e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1875739267932928:0@lo:104: 00010000:00010000:1.0:1788844788.357198:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844788.357206:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844788.357211:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844788.357216:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0031800/0x7f1093851e2da543 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844788.363397:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+18:15763:x1875739267932288:12345-0@lo:253:mount.lustre.0 Request processed in 72107us (72191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844788.363427:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788844788.363738:0:15763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:661a174e-3914-46cb-b31b-f72a0fba243b:15763:1875739267932288:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788844788.363754:0:15763:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788844788.363757:0:15763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788844788.363759:0:15763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788844788.363761:0:15763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788844788.363762:0:15763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788844788.363763:0:15763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788844788.363765:0:15763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788844788.363766:0:15763:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788844788.363768:0:15763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788844788.363770:0:15763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788844788.363854:0:15763:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788844788.374783:0:15763:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788844788.374949:0:15763:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788844788.375122:0:15763:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788844788.375274:0:15763:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788844788.375423:0:15763:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788844788.375666:0:15763:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788844788.376573:0:15763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788844788.443453:0:15763:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788844788.443529:0:15763:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788844788.443720:0:15763:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788844788.443807:0:15763:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.143@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788844788.443822:0:15763:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788844788.443851:0:15763:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788844789.182108:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844790.205829:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788844790.398849:0:14355:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788844790.398859:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91eed0770000 from 8 10000000:01000000:0.0:1788844790.398866:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788844790.398917:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0030c00/0x7f1093851e2da54a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844790.398930:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec0030c00/0x7f1093851e2da54a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844790.398952:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec0030c00/0x7f1093851e2da54a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844790.398980:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267933184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788844790.399053:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844790.399116:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788844790.399140:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267933184 00000100:00100000:0.0:1788844790.399148:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267933184 00000100:00100000:0.0:1788844790.399202:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788844790.399211:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+18:14355:x1875739267933184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844790.399226:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844790.399240:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0031a00/0x7f1093851e2da551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da54a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844790.399264:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0031a00/0x7f1093851e2da551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da54a expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844790.399275:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0031a00/0x7f1093851e2da551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da54a expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844790.399283:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031a00, rc 0) 00000100:00100000:0.0:1788844790.399340:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+19:14355:x1875739267933184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844790.399347:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788844790.399398:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267933184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844790.399414:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec0030c00/0x7f1093851e2da54a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da551 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844790.399435:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec0030c00/0x7f1093851e2da54a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da551 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844790.399486:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267933312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788844790.399520:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844790.399569:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788844790.399583:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267933312 00000100:00100000:0.0:1788844790.399587:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267933312 00000100:00100000:0.0:1788844790.399611:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788844790.399618:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:14355:x1875739267933312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788844790.399632:0:14353:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788844790.399651:0:14353:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788844790.399654:0:14353:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788844790.399729:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:14355:x1875739267933312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844790.399737:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788844790.399768:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267933312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788844790.399824:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788844790.399831:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec0030c00/0x7f1093851e2da54a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da551 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844790.399839:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec0030c00/0x7f1093851e2da54a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da551 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844791.033976:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267933440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844791.034063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844791.034219:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267933440 00000100:00100000:3.0:1788844791.034228:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267933440 00000100:00100000:3.0:1788844791.034299:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788844791.034311:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267933440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844791.034346:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844791.034397:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267933440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844791.034404:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788844791.034452:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267933440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788844791.034519:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788844791.226012:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844792.253595:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844793.273791:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788844793.605578:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788844793.605585:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788844793.605589:0:36:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788844793.605601:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eec3808800 using connection 192.168.204.143@tcp/0@lo 00000100:00100000:0.0:1788844793.605626:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91eefb06ad80 x1875739267933824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788844793.605711:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:661a174e-3914-46cb-b31b-f72a0fba243b:3305:1875739267933568:0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.605778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844793.605820:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267934208:0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.605843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844793.605865:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788844793.605883:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267933696:0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.605908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844793.605936:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267933824:0@lo:8:kworker.0 00000100:00100000:0.0:1788844793.605956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844793.605978:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267933952:0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.605998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844793.606013:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788844793.606018:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267934080:0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.606052:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844793.606085:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267933568 00000100:00100000:0.0:1788844793.606092:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267933568 00000100:00100000:0.0:1788844793.606133:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788844793.606142:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:3305:x1875739267933568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.606186:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:3305:x1875739267933568:12345-0@lo:400:kworker.0 Request processed in 45us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844793.606193:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788844793.606220:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267934208 00000100:00100000:0.0:1788844793.606224:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267934208 00000100:00100000:0.0:1788844793.606250:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267933952 00000100:00100000:0.0:1788844793.606253:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267933952 00000100:00100000:0.0:1788844793.606271:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267934080 00000100:00100000:0.0:1788844793.606273:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267934080 00000100:00100000:0.0:1788844793.606288:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788844793.606294:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267934208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.606322:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267934208:12345-0@lo:400:kworker.0 Request processed in 28us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844793.606328:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788844793.606339:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788844793.606344:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb06b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267933952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.606490:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb06b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875739267933952:12345-0@lo:400:kworker.0 Request processed in 145us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844793.606497:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788844793.606511:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788844793.606517:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267934080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.606561:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875739267934080:12345-0@lo:400:kworker.0 Request processed in 45us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844793.606567:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788844793.606583:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267933696 00000100:00100000:0.0:1788844793.606587:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267933696 00000100:00100000:0.0:1788844793.606610:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267933824 00000100:00100000:0.0:1788844793.606613:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267933824 00000100:00100000:0.0:1788844793.606624:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788844793.606630:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267933696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.606660:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267933696:12345-0@lo:400:kworker.0 Request processed in 31us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844793.606665:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788844793.606677:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788844793.606688:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875739267933824:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788844793.606710:0:15046:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:0.0:1788844793.606736:0:15046:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7f1093851e2da558 00002000:00100000:0.0:1788844793.606749:0:15046:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91edc2845000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788844793.606754:0:15046:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788844793.606756:0:15046:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788844793.609281:0:15046:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788844793.609317:0:15046:0:(import.c:65:import_set_state_nolock()) ffff91edc2840000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844793.609596:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875739267933824:12345-0@lo:8:kworker.0 Request processed in 2903us (3636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844793.609606:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788844793.609667:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844793.609673:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788844793.609712:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb06aa00 x1875739267934080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844793.609728:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875739267934080:0@lo:400:kworker.0 00010000:00080000:0.0:1788844793.609741:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb068e00 x1875739267933952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844793.609750:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875739267933952:0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.609786:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267933696:0@lo:400:kworker.0 00000100:00100000:0.0:1788844793.609797:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:661a174e-3914-46cb-b31b-f72a0fba243b:3305:1875739267933568:0@lo:400:kworker.0 00010000:00080000:0.0:1788844793.609806:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb069880 x1875739267934208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788844809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844793.609814:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267934208:0@lo:400:kworker.0 00010000:00080000:3.0:1788844793.610015:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91eefb06ad80 x1875739267933824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788844818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788844793.610041:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788844793.610049:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788844793.610055:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788844793.610057:0:3304:0:(import.c:65:import_set_state_nolock()) ffff91eec3808800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788844793.610078:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788844793.610083:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875739267933824:0@lo:8:kworker.0 00000004:00080000:3.0:1788844793.610128:0:14383:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788844793.610147:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01708a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1875739267934464:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788844793.610184:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844793.610202:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4d136c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788844793.610327:0:14382:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788844793.613024:0:14382:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 507891485341ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788844793.613117:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267934336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844793.614974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844793.615057:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267934464 00000100:00100000:0.0:1788844793.615065:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267934464 00000100:00100000:0.0:1788844793.615117:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788844793.615126:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14383:x1875739267934464:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788844793.617026:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267934336 00000100:00100000:2.0:1788844793.617039:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267934336 00000100:00100000:2.0:1788844793.617090:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788844793.617099:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875739267934336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788844793.617132:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844793.617207:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875739267934336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844793.617214:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788844793.617371:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788844793.626639:0:15046:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788844793.626651:0:15046:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788844793.626656:0:15046:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00010000:00080000:0.0:1788844793.639104:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ef01708380 x1875739267934336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788844809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788844793.639132:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01708380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267934336:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1788844793.640920:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.640934:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da55f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.640951:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.640956:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.640969:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.640988:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.640998:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641006:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641027:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788844793.641040:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844793.641046:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641054:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844793.641059:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641067:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da55f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641081:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da55f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641098:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da55f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641118:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844793.641120:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844793.641122:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788844793.641661:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.641667:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da566 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641677:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.641680:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.641685:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641694:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641702:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641709:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641738:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788844793.641747:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844793.641758:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641764:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844793.641768:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641776:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da566 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641788:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da566 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641795:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da566 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.641808:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844793.641809:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844793.641811:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788844793.642196:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.642202:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da56d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.642210:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.642213:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.642217:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.642237:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.642246:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.642253:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.642267:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788844793.642276:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844793.642280:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.642286:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844793.642290:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.642297:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da56d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.642308:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da56d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.642315:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da56d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.642334:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844793.642336:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844793.642338:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788844793.647252:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.647270:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f73330/0x7f1093851e2da574 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.647289:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.647294:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.647301:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f73330/0x7f1093851e2da574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.647317:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f73330/0x7f1093851e2da574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.647342:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f73330/0x7f1093851e2da574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.647351:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f73330/0x7f1093851e2da574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.647676:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.647705:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.647713:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9f73330/0x7f1093851e2da574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.647723:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61400 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.647727:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f73330/0x7f1093851e2da574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.647736:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f73330/0x7f1093851e2da574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.647769:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9f73330/0x7f1093851e2da574 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.647776:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f73330/0x7f1093851e2da574 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.647802:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.647804:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.647806:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788844793.656386:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.656398:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da57b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.656416:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.656428:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.656435:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da57b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.656452:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da57b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.656463:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da57b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.656472:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.656490:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788844793.656504:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788844793.656509:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.656517:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844793.656521:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da57b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.656531:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da57b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.656574:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da57b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.656594:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fbab0e3/0x7f1093851e2da57b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.656613:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844793.656615:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788844793.656618:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788844793.659532:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.659564:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847e5b44/0x7f1093851e2da582 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.659581:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.659586:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.659592:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000847e5b44/0x7f1093851e2da582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.659605:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000847e5b44/0x7f1093851e2da582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.659615:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847e5b44/0x7f1093851e2da582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.659623:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000847e5b44/0x7f1093851e2da582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.659644:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844793.660941:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844793.660954:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000847e5b44/0x7f1093851e2da582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.660965:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844793.660970:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000847e5b44/0x7f1093851e2da582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.660980:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000847e5b44/0x7f1093851e2da582 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.661004:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000847e5b44/0x7f1093851e2da582 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.661012:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000847e5b44/0x7f1093851e2da582 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.661039:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.661051:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.661053:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788844793.663587:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.663606:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c312996/0x7f1093851e2da589 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.663622:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.663626:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.663632:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c312996/0x7f1093851e2da589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.663647:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c312996/0x7f1093851e2da589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.663658:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c312996/0x7f1093851e2da589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.663666:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c312996/0x7f1093851e2da589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.663695:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844793.663800:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844793.663882:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c312996/0x7f1093851e2da589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.663891:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844793.663896:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c312996/0x7f1093851e2da589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.663904:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c312996/0x7f1093851e2da589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.663921:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c312996/0x7f1093851e2da589 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.663928:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c312996/0x7f1093851e2da589 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.663946:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.663948:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.663950:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788844793.666423:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.666435:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2da590 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.666449:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.666453:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.666459:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2da590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.666472:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2da590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.666490:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2da590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.666498:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2da590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.666523:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844793.667104:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844793.667112:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2da590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.667121:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60400 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844793.667125:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2da590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.667142:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2da590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.667158:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2da590 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.667165:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a286ad/0x7f1093851e2da590 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.667186:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.667188:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.667190:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788844793.668317:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.668327:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da597 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.668339:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.668343:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.668348:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.668359:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.668368:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.668374:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.668406:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788844793.668807:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.668813:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da59e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.668821:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.668824:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.668828:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da59e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.668836:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da59e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.668843:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da59e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.668851:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da59e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.668888:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788844793.668906:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788844793.668913:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.668921:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844793.668925:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.668934:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da597 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.668950:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da597 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.668958:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beaa290c/0x7f1093851e2da597 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.668976:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844793.668980:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da59e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.668997:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844793.669001:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da59e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.669009:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da59e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.669019:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da59e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.669027:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aac9840f/0x7f1093851e2da59e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.669041:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844793.669042:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844793.669044:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.669650:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788844793.671600:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788844793.671613:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000139962db/0x7f1093851e2da5a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.671628:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788844793.671638:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844793.671645:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000139962db/0x7f1093851e2da5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.671659:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000139962db/0x7f1093851e2da5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.671667:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000139962db/0x7f1093851e2da5a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.671674:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000139962db/0x7f1093851e2da5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844793.671696:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788844793.672956:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844793.672967:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000139962db/0x7f1093851e2da5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.672979:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844793.672983:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000139962db/0x7f1093851e2da5a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.672993:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000139962db/0x7f1093851e2da5a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.673019:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000139962db/0x7f1093851e2da5a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.673026:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000139962db/0x7f1093851e2da5a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.673049:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844793.673052:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844793.673054:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.675090:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.675101:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da5ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675118:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.675122:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.675128:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675141:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675150:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da5ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675163:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da5ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675186:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788844793.675563:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.675569:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da5b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675578:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.675581:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.675586:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da5b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675595:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da5b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675603:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da5b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675611:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675767:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788844793.675780:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788844793.675786:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da5ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675799:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844793.675862:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da5ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675883:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da5ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675900:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da5ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675908:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da5ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675924:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844793.675928:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675934:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170c800 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844793.675937:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675945:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da5b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675954:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da5b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675967:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da5b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.675979:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.675980:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.675982:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.676409:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.676415:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4d2c71a/0x7f1093851e2da5ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.676423:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.676427:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.676432:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4d2c71a/0x7f1093851e2da5ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.676442:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4d2c71a/0x7f1093851e2da5ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.676450:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4d2c71a/0x7f1093851e2da5ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.676457:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4d2c71a/0x7f1093851e2da5ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.676472:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788844793.677674:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844793.677685:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4d2c71a/0x7f1093851e2da5ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.677695:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844793.677700:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4d2c71a/0x7f1093851e2da5ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.677709:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4d2c71a/0x7f1093851e2da5ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.677724:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4d2c71a/0x7f1093851e2da5ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.677731:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4d2c71a/0x7f1093851e2da5ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844793.677764:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844793.677766:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844793.677768:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844793.677774:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.680475:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.680494:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.680511:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.680516:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.680523:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.680558:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.680570:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.680578:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.680595:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844793.680607:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844793.680613:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.680620:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170de00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844793.680625:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.680634:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.680659:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.680667:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.680685:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.680687:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.680689:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.684915:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.684927:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b4e47ad/0x7f1093851e2da5c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.684944:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.684949:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.684955:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b4e47ad/0x7f1093851e2da5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.684969:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b4e47ad/0x7f1093851e2da5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.684980:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b4e47ad/0x7f1093851e2da5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.684987:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b4e47ad/0x7f1093851e2da5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.685025:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.685194:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.685203:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b4e47ad/0x7f1093851e2da5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.685213:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d400 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.685219:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b4e47ad/0x7f1093851e2da5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.685229:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b4e47ad/0x7f1093851e2da5c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.685246:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b4e47ad/0x7f1093851e2da5c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.685254:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b4e47ad/0x7f1093851e2da5c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.685288:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.685290:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.685292:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.685448:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.685453:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b0da69/0x7f1093851e2da5cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.685462:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.685465:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.685469:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090b0da69/0x7f1093851e2da5cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.685478:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090b0da69/0x7f1093851e2da5cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.685486:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090b0da69/0x7f1093851e2da5cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.685492:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090b0da69/0x7f1093851e2da5cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.685515:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.685601:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.685608:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090b0da69/0x7f1093851e2da5cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.685616:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170ca00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.685620:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b0da69/0x7f1093851e2da5cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.685629:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090b0da69/0x7f1093851e2da5cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.685642:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090b0da69/0x7f1093851e2da5cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.685649:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b0da69/0x7f1093851e2da5cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.685670:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.685672:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.685674:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.685963:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.685969:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a229ec47/0x7f1093851e2da5d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.685977:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.685986:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.685990:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a229ec47/0x7f1093851e2da5d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.686001:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a229ec47/0x7f1093851e2da5d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.686009:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a229ec47/0x7f1093851e2da5d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.686016:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a229ec47/0x7f1093851e2da5d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.686039:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.686127:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.686134:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a229ec47/0x7f1093851e2da5d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.686153:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170ce00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.686157:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a229ec47/0x7f1093851e2da5d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.686165:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a229ec47/0x7f1093851e2da5d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.686178:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a229ec47/0x7f1093851e2da5d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.686185:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a229ec47/0x7f1093851e2da5d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.686205:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.686207:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.686211:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.686442:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.686448:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000510f1162/0x7f1093851e2da5dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.686456:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.686459:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.686463:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000510f1162/0x7f1093851e2da5dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.686473:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000510f1162/0x7f1093851e2da5dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.686482:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000510f1162/0x7f1093851e2da5dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.686495:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000510f1162/0x7f1093851e2da5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.686515:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.686576:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.686582:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000510f1162/0x7f1093851e2da5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.686590:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170c400 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.686594:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000510f1162/0x7f1093851e2da5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.686603:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000510f1162/0x7f1093851e2da5dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.686623:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000510f1162/0x7f1093851e2da5dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.686630:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000510f1162/0x7f1093851e2da5dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.686646:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.686649:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.686651:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.687990:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.688001:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1d815e9/0x7f1093851e2da5e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.688013:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.688017:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.688022:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1d815e9/0x7f1093851e2da5e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.688033:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1d815e9/0x7f1093851e2da5e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.691062:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1d815e9/0x7f1093851e2da5e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.691081:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1d815e9/0x7f1093851e2da5e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.691125:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.691149:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.691159:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1d815e9/0x7f1093851e2da5e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.691170:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170c600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.691175:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1d815e9/0x7f1093851e2da5e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.691186:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1d815e9/0x7f1093851e2da5e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.691207:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1d815e9/0x7f1093851e2da5e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.691215:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1d815e9/0x7f1093851e2da5e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.691257:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.691259:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.691262:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.691779:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.691787:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6212f44/0x7f1093851e2da5eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.691886:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.691892:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.691899:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6212f44/0x7f1093851e2da5eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.691912:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6212f44/0x7f1093851e2da5eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.691921:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6212f44/0x7f1093851e2da5eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.691928:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6212f44/0x7f1093851e2da5eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.691949:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.692135:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.692142:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6212f44/0x7f1093851e2da5eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.692151:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170c200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.692155:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6212f44/0x7f1093851e2da5eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.692164:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6212f44/0x7f1093851e2da5eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.692176:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6212f44/0x7f1093851e2da5eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.692182:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6212f44/0x7f1093851e2da5eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.692198:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.692200:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.692202:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.692335:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.692341:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012fa5e3a/0x7f1093851e2da5f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.692349:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.692352:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.692356:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012fa5e3a/0x7f1093851e2da5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.692365:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012fa5e3a/0x7f1093851e2da5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.692386:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012fa5e3a/0x7f1093851e2da5f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.692392:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012fa5e3a/0x7f1093851e2da5f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.692412:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.693296:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.693304:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012fa5e3a/0x7f1093851e2da5f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.693325:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170dc00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.693330:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012fa5e3a/0x7f1093851e2da5f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.693339:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012fa5e3a/0x7f1093851e2da5f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.693353:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012fa5e3a/0x7f1093851e2da5f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.693360:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012fa5e3a/0x7f1093851e2da5f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.693375:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.693377:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.693379:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.694730:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.694743:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.694757:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.694761:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.694767:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.694779:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.694789:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.694796:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.694840:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844793.694853:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844793.694858:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.694866:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170de00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844793.694882:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.694891:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.694905:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.694911:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052917bbd/0x7f1093851e2da5f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.694929:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.694931:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.694932:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.695430:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.695436:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da600 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.695446:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.695456:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.695461:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.695471:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.695480:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.695487:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.695504:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788844793.695514:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844793.695518:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.695526:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170c800 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844793.695529:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.695567:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.695578:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da600 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.695596:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f708e92f/0x7f1093851e2da600 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.695611:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.695613:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844793.695615:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.699058:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.699070:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da607 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.699087:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.699091:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.699097:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.699112:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.699122:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da607 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.699130:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.699156:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.699378:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.699388:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.699398:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.699403:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da607 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.699413:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da607 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.699441:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da607 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.699449:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa633551/0x7f1093851e2da607 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.699475:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.699478:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.699481:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.699574:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.699587:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025832ed7/0x7f1093851e2da60e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.699596:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.699600:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.699604:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025832ed7/0x7f1093851e2da60e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.699614:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025832ed7/0x7f1093851e2da60e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.699623:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025832ed7/0x7f1093851e2da60e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.699630:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025832ed7/0x7f1093851e2da60e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.699654:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.699792:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.699799:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025832ed7/0x7f1093851e2da60e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.699806:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170c000 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.699810:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025832ed7/0x7f1093851e2da60e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.699818:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025832ed7/0x7f1093851e2da60e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.699830:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025832ed7/0x7f1093851e2da60e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.699837:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025832ed7/0x7f1093851e2da60e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.699867:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.699878:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.699881:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.700076:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.700082:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006071679e/0x7f1093851e2da615 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.700091:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.700094:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.700099:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006071679e/0x7f1093851e2da615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.700108:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006071679e/0x7f1093851e2da615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.700123:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006071679e/0x7f1093851e2da615 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.700131:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006071679e/0x7f1093851e2da615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.700155:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.700264:0:15463:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.700270:0:15463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006071679e/0x7f1093851e2da615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.700278:0:15463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d800 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.700281:0:15463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006071679e/0x7f1093851e2da615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.700289:0:15463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006071679e/0x7f1093851e2da615 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.700301:0:15463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006071679e/0x7f1093851e2da615 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.700308:0:15463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006071679e/0x7f1093851e2da615 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.700327:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.700329:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.700332:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788844793.700581:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788844793.700587:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000447f9876/0x7f1093851e2da61c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.700596:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1788844793.700599:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844793.700602:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000447f9876/0x7f1093851e2da61c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.700612:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000447f9876/0x7f1093851e2da61c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.700620:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000447f9876/0x7f1093851e2da61c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.700626:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000447f9876/0x7f1093851e2da61c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844793.700658:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788844793.700790:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788844793.700796:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000447f9876/0x7f1093851e2da61c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.700817:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844793.700821:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000447f9876/0x7f1093851e2da61c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.700829:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000447f9876/0x7f1093851e2da61c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788844793.700835:0:15046:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:0.0:1788844793.700840:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000447f9876/0x7f1093851e2da61c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.700848:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000447f9876/0x7f1093851e2da61c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844793.700863:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.700865:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788844793.700867:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844793.700964:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14383:x1875739267934464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 85834us (90775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844793.700974:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788844793.701486:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01708a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1875739267934464:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788844793.701503:0:14383:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788844793.701568:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb06b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1875739267934592:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788844793.701609:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844793.701662:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed08cd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844793.701692:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267934592 00000100:00100000:0.0:1788844793.701698:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267934592 00000100:00100000:0.0:1788844793.701737:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788844793.701746:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14383:x1875739267934592:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788844793.701791:0:15043:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788844793.711014:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14383:x1875739267934592:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9261us (9395us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788844793.711028:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788844793.711152:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb06b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1875739267934592:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788844793.711169:0:14383:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:1.0:1788844793.714745:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788844794.300470:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788844795.189503:0:16118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg443-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788844795.322875:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844796.156846:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267934720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844796.156913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844796.157012:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267934720 00000100:00100000:2.0:1788844796.157020:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267934720 00000100:00100000:2.0:1788844796.157079:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788844796.157088:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267934720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844796.157121:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844796.157165:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267934720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844796.157173:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788844796.157287:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788844796.157333:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267934720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788844796.346690:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844797.370339:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844797.665493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844797.665640:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244866688 00000100:00100000:0.0:1788844797.665651:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244866688 00000100:00100000:0.0:1788844797.665702:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:0.0:1788844797.665710:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1875739244866688:12345-192.168.204.43@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788844797.665738:0:14350:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 43808ea0-7b80-4845-b465-28f13dbe0884@192.168.204.43@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:0.0:1788844797.665770:0:14350:0:(genops.c:1385:class_connect()) connect: client 43808ea0-7b80-4845-b465-28f13dbe0884, cookie 0x7f1093851e2da623 00000100:00080000:0.0:1788844797.665918:0:14350:0:(import.c:65:import_set_state_nolock()) ffff91edc2842800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844797.665993:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+5:2353:x1875739244866688:12345-192.168.204.43@tcp:250:mount.lustre.0 Request processed in 281us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844797.666001:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 75 00000100:00100000:0.0:1788844797.671580:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844797.671832:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244866816 00000100:00100000:2.0:1788844797.671845:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244866816 00000100:00100000:2.0:1788844797.671906:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:2.0:1788844797.671917:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+5:13755:x1875739244866816:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788844797.671935:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844797.671977:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ef0170c800/0x7f1093851e2da62a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793fce4 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844797.672014:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0170c800/0x7f1093851e2da62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fce4 expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844797.672025:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ef0170c800/0x7f1093851e2da62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fce4 expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844797.672035:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0170c800, rc 0) 00000100:00100000:2.0:1788844797.672108:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+6:13755:x1875739244866816:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 192us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844797.672115:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 76 00000100:00100000:3.0:1788844797.674230:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844797.674519:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244866944 00000100:00100000:2.0:1788844797.674529:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244866944 00000100:00100000:2.0:1788844797.674613:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 77 00000100:00100000:2.0:1788844797.674624:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+6:13755:x1875739244866944:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788844797.674942:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+6:13755:x1875739244866944:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 320us (719us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788844797.674951:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 77 00000100:00100000:1.0:1788844797.686451:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844797.688347:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244867072 00000100:00100000:0.0:1788844797.688379:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244867072 00000100:00100000:0.0:1788844797.688467:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:0.0:1788844797.688479:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+6:13755:x1875739244867072:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788844797.688522:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844797.688569:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0030800/0x7f1093851e2da631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793fceb expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844797.688601:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0030800/0x7f1093851e2da631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fceb expref: 7 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844797.688613:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0030800/0x7f1093851e2da631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fceb expref: 7 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844797.688622:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030800, rc 0) 00000100:00100000:0.0:1788844797.688693:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+7:13755:x1875739244867072:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 216us (2256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844797.688701:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 78 00000100:00100000:3.0:1788844797.698027:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844797.698389:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244867200 00000100:00100000:2.0:1788844797.698400:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244867200 00000100:00100000:2.0:1788844797.698469:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:2.0:1788844797.698480:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+7:13755:x1875739244867200:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788844797.698828:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+8:13755:x1875739244867200:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 349us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844797.698837:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 79 00000100:00100000:3.0:1788844797.710147:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844797.711308:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244867328 00000100:00100000:2.0:1788844797.711322:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244867328 00000100:00100000:2.0:1788844797.711385:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:2.0:1788844797.711395:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+8:13755:x1875739244867328:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788844797.711656:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+8:13755:x1875739244867328:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 261us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844797.711664:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 80 00000100:00100000:3.0:1788844797.725657:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844797.731978:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244867456 00000100:00100000:1.0:1788844797.732000:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244867456 00000100:00100000:1.0:1788844797.732493:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 81 00000100:00100000:1.0:1788844797.732512:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+8:13773:x1875739244867456:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788844797.733985:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+8:13773:x1875739244867456:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 1469us (8337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844797.734710:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 81 00000040:00080000:1.0:1788844797.756839:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788844797.760785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844797.762073:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244867584 00000100:00100000:0.0:1788844797.762089:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244867584 00000100:00100000:0.0:1788844797.762174:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:0.0:1788844797.762185:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+8:13773:x1875739244867584:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788844797.762483:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+8:13773:x1875739244867584:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 298us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844797.762492:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 82 00000100:00100000:2.0:1788844797.780811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844797.781402:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244867712 00000100:00100000:1.0:1788844797.781420:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244867712 00000100:00100000:1.0:1788844797.781487:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00100000:1.0:1788844797.781513:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+8:13755:x1875739244867712:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788844797.781529:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844797.781603:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed0d60200/0x7f1093851e2da638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793fd15 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844797.781635:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d60200/0x7f1093851e2da638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd15 expref: 9 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844797.781646:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed0d60200/0x7f1093851e2da638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd15 expref: 9 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844797.781655:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60200, rc 0) 00000100:00100000:1.0:1788844797.781723:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+9:13755:x1875739244867712:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 211us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844797.781731:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 83 00000100:00100000:3.0:1788844797.788633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844797.788735:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244867840 00000100:00100000:2.0:1788844797.788755:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244867840 00000100:00100000:2.0:1788844797.788846:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:2.0:1788844797.788860:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb4b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+9:13755:x1875739244867840:12345-192.168.204.43@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788844797.788891:0:14352:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788844797.788919:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788844797.788924:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788844797.788927:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788844797.788930:0:14352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788844797.795995:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb4b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+9:13755:x1875739244867840:12345-192.168.204.43@tcp:256:mount.lustre.0 Request processed in 7125us (7369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844797.796012:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 84 00000100:00100000:3.0:1788844797.814313:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844797.814859:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244867968 00000100:00100000:0.0:1788844797.814873:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244867968 00000100:00100000:0.0:1788844797.814943:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:0.0:1788844797.814954:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+9:13755:x1875739244867968:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788844797.814971:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844797.815005:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0031800/0x7f1093851e2da63f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793fd1c expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844797.815035:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0031800/0x7f1093851e2da63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd1c expref: 10 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844797.815047:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0031800/0x7f1093851e2da63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd1c expref: 10 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844797.815067:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031800, rc 0) 00000100:00100000:0.0:1788844797.815133:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+10:13755:x1875739244867968:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 180us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844797.815139:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 85 00000100:00100000:3.0:1788844797.818594:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844797.818832:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244868096 00000100:00100000:2.0:1788844797.818844:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244868096 00000100:00100000:2.0:1788844797.818899:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:2.0:1788844797.818909:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+10:13755:x1875739244868096:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788844797.819394:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd328850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+10:13755:x1875739244868096:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 411us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844797.819413:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 86 00000100:00100000:3.0:1788844797.824298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844797.824686:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244868224 00000100:00100000:1.0:1788844797.824697:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244868224 00000100:00100000:1.0:1788844797.824758:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00100000:1.0:1788844797.824769:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+10:13755:x1875739244868224:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788844797.825017:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+10:13755:x1875739244868224:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 249us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844797.825025:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 87 00000100:00100000:3.0:1788844797.840146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844797.840582:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244868352 00000100:00100000:2.0:1788844797.840594:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244868352 00000100:00100000:2.0:1788844797.840652:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:2.0:1788844797.840662:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+10:13778:x1875739244868352:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788844797.840925:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+10:13778:x1875739244868352:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 263us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844797.840933:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 88 00000100:00100000:3.0:1788844797.843101:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844797.843267:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244868480 00000100:00100000:0.0:1788844797.843276:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244868480 00000100:00100000:0.0:1788844797.843341:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 89 00000100:00100000:0.0:1788844797.843352:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+10:13778:x1875739244868480:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788844797.843603:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd328c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+10:13778:x1875739244868480:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 252us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844797.843611:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 89 00000100:00100000:3.0:1788844797.846780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844797.846914:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244868608 00000100:00100000:0.0:1788844797.846927:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244868608 00000100:00100000:0.0:1788844797.846986:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:0.0:1788844797.846993:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1875739244868608:12345-192.168.204.43@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788844797.847025:0:14358:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39@192.168.204.43@tcp t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:0.0:1788844797.847221:0:14358:0:(genops.c:1385:class_connect()) connect: client 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39, cookie 0x7f1093851e2da646 00000004:00100000:0.0:1788844797.847257:0:14358:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788844797.847278:0:14358:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788844797.935920:0:14358:0:(import.c:65:import_set_state_nolock()) ffff91eef3792000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788844797.936061:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2353:x1875739244868608:12345-192.168.204.43@tcp:38:mount.lustre.0 Request processed in 89064us (89292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844797.936074:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:3.0:1788844797.945237:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844797.945285:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844797.946250:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244868864 00000100:00100000:1.0:1788844797.946280:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244868864 00000100:00100000:1.0:1788844797.946408:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244868736 00000100:00100000:1.0:1788844797.946412:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244868736 00000100:00100000:1.0:1788844797.946433:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:1.0:1788844797.946443:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef0170bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:13755:x1875739244868864:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788844797.946490:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1788844797.946753:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844797.946934:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef0170bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:13755:x1875739244868864:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 490us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844797.946943:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:1.0:1788844797.946965:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:1.0:1788844797.946973:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:0:x1875739244868736:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788844797.946987:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788844797.947012:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:0:x1875739244868736:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 41us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844797.947020:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:3.0:1788844797.950704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844797.950830:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244868992 00000100:00100000:1.0:1788844797.950842:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244868992 00000100:00100000:1.0:1788844797.950911:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:1.0:1788844797.950923:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:13755:x1875739244868992:12345-192.168.204.43@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788844797.951043:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:13755:x1875739244868992:12345-192.168.204.43@tcp:40:mount.lustre.0 Request processed in 121us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844797.951052:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:3.0:1788844797.954102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844797.954224:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244869376 00000100:00100000:0.0:1788844797.954234:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244869376 00000100:00100000:0.0:1788844797.954299:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:0.0:1788844797.954309:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef0170b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:13755:x1875739244869376:12345-192.168.204.43@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788844797.961210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844797.961482:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244869120 00000100:00100000:0.0:1788844797.961493:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244869120 00000100:00100000:0.0:1788844797.961561:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:0.0:1788844797.961571:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875739244869120:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788844797.961605:0:15046:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39@192.168.204.43@tcp t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:0.0:1788844797.961641:0:15046:0:(genops.c:1385:class_connect()) connect: client 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39, cookie 0x7f1093851e2da64d 00002000:00100000:0.0:1788844797.961663:0:15046:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39/ffff91edc2845800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788844797.961689:0:15046:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788844797.962041:0:15046:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788844797.962075:0:15046:0:(import.c:65:import_set_state_nolock()) ffff91edc2847800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844797.962143:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2353:x1875739244869120:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 571us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844797.962151:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:3.0:1788844797.963217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844797.963350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844797.963379:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244869504 00000100:00100000:3.0:1788844797.963387:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244869504 00000100:00100000:3.0:1788844797.963425:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:3.0:1788844797.963433:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+10:2357:x1875739244869504:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844797.963496:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd329850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+10:2357:x1875739244869504:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 64us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844797.963504:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 90 00000100:00100000:0.0:1788844797.964839:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244869248 00000100:00100000:0.0:1788844797.964854:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244869248 00000100:00100000:0.0:1788844797.964892:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:0.0:1788844797.964898:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef0170a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875739244869248:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788844797.964926:0:15043:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39@192.168.204.43@tcp t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:0.0:1788844797.964960:0:15043:0:(genops.c:1385:class_connect()) connect: client 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39, cookie 0x7f1093851e2da654 00002000:00100000:0.0:1788844797.964972:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39/ffff91edc2841000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788844797.965006:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788844797.965234:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788844797.965268:0:15043:0:(import.c:65:import_set_state_nolock()) ffff91eef3160000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844797.965346:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef0170a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2353:x1875739244869248:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 446us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844797.965354:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000004:00080000:0.0:1788844797.969100:0:14361:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 14607us 00000004:00200000:3.0:1788844797.984028:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788844797.984166:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef0170b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:13755:x1875739244869376:12345-192.168.204.43@tcp:33:mount.lustre.0 Request processed in 29841us (30057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844797.984183:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:2.0:1788844798.277995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844798.278113:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244869632 00000100:00100000:0.0:1788844798.278124:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244869632 00000100:00100000:0.0:1788844798.278194:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1788844798.278204:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:13799:x1875739244869632:12345-192.168.204.43@tcp:101:mkdir.0 00010000:00010000:0.0:1788844798.278223:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844798.278249:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2da65b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fd46 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844798.278316:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2da662 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844798.278330:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2da662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844798.278345:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2da662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844798.278382:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788844798.278386:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788844798.278422:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2da662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844798.278467:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0031c00/0x7f1093851e2da65b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd46 expref: 8 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844798.278487:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2da662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd46 expref: 7 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844798.278496:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796800) 00010000:00010000:0.0:1788844798.278499:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788844798.278502:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0030600, rc 0) 00000100:00100000:0.0:1788844798.278624:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:13799:x1875739244869632:12345-192.168.204.43@tcp:101:mkdir.0 Request processed in 420us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844798.278631:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00010000:00010000:0.0:1788844798.393973:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844798.714686:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267934848:0@lo:400:kworker.0 00000100:00100000:3.0:1788844798.714764:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844798.714826:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267935360:0@lo:400:kworker.0 00000100:00100000:3.0:1788844798.714854:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844798.714876:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844798.714881:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875739267935232:0@lo:400:kworker.0 00000100:00100000:3.0:1788844798.714936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844798.714972:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267935360 00000100:00100000:3.0:1788844798.714979:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267935360 00000100:00100000:3.0:1788844798.715029:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267935232 00000100:00100000:3.0:1788844798.715032:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267935232 00000100:00100000:3.0:1788844798.715048:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788844798.715056:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267935360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844798.715106:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267935360:12345-0@lo:400:kworker.0 Request processed in 51us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844798.715114:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788844798.715131:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788844798.715137:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875739267935232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844798.715176:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875739267935232:12345-0@lo:400:kworker.0 Request processed in 39us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844798.715182:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788844798.715199:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844798.715229:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875739267935232:0@lo:400:kworker.0 00000100:00100000:3.0:1788844798.715241:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267935360:0@lo:400:kworker.0 00000100:00100000:3.0:1788844798.715278:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267934848 00000100:00100000:3.0:1788844798.715282:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267934848 00000100:00100000:1.0:1788844798.715680:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788844798.715692:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267934848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844798.715741:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd328050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267934848:12345-0@lo:400:kworker.0 Request processed in 52us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844798.715754:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788844798.715802:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267934848:0@lo:400:kworker.0 00000100:00100000:0.0:1788844798.716099:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267934976:0@lo:400:kworker.0 00000100:00100000:0.0:1788844798.716137:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844798.716161:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267935488:0@lo:400:kworker.0 00000100:00100000:0.0:1788844798.716189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844798.716205:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788844798.716211:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267935104:0@lo:400:kworker.0 00000100:00100000:0.0:1788844798.716229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844798.716256:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267935488 00000100:00100000:0.0:1788844798.716261:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267935488 00000100:00100000:0.0:1788844798.716297:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788844798.716303:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267935488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844798.716355:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267935488:12345-0@lo:400:kworker.0 Request processed in 52us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844798.716369:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788844798.716389:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267934976 00000100:00100000:0.0:1788844798.716393:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267934976 00000100:00100000:0.0:1788844798.716418:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267935104 00000100:00100000:0.0:1788844798.716421:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267935104 00000100:00100000:0.0:1788844798.716437:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788844798.716443:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267934976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844798.716474:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb06aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267934976:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844798.716480:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788844798.716491:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788844798.716497:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875739267935104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844798.716519:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875739267935104:12345-0@lo:400:kworker.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00080000:1.0:1788844798.716864:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788844798.716870:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788844798.716872:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844798.716926:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267935104:0@lo:400:kworker.0 00000100:00100000:1.0:1788844798.716937:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267934976:0@lo:400:kworker.0 00000100:00100000:1.0:1788844798.716952:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267935488:0@lo:400:kworker.0 00000100:00100000:0.0:1788844798.718178:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788844798.725783:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788844798.725810:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91edc24fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267935616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844798.725905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844798.725961:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267935616 00000100:00100000:2.0:1788844798.725969:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267935616 00000100:00100000:2.0:1788844798.726016:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844798.726025:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875739267935616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788844798.726048:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844798.726093:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875739267935616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844798.726101:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844798.726152:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91edc24fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267935616:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788844798.870730:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39 00000001:00080000:0.0:1788844798.870749:0:7640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788844798.870758:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788844799.417794:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844800.411214:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844800.411832:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244869760 00000100:00100000:3.0:1788844800.411849:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244869760 00000100:00100000:3.0:1788844800.411943:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:3.0:1788844800.411955:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:13851:x1875739244869760:12345-192.168.204.43@tcp:41:lfs.0 00000004:00000024:3.0:1788844800.411999:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788844800.412092:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:13851:x1875739244869760:12345-192.168.204.43@tcp:41:lfs.0 Request processed in 139us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844800.412101:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00080000:1.0:1788844800.412228:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844800.419789:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844800.420955:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244869888 00000100:00100000:0.0:1788844800.420970:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244869888 00000100:00100000:0.0:1788844800.421061:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:0.0:1788844800.421073:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:13851:x1875739244869888:12345-192.168.204.43@tcp:13:lfs.0 00002000:00000024:0.0:1788844800.421112:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844800.421209:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:13851:x1875739244869888:12345-192.168.204.43@tcp:13:lfs.0 Request processed in 137us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844800.421231:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00080000:1.0:1788844800.421317:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788844800.427133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844800.427277:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244870016 00000100:00100000:2.0:1788844800.427293:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244870016 00000100:00100000:2.0:1788844800.427396:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:2.0:1788844800.427408:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:13851:x1875739244870016:12345-192.168.204.43@tcp:13:lfs.0 00002000:00000024:2.0:1788844800.427462:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844800.427596:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:13851:x1875739244870016:12345-192.168.204.43@tcp:13:lfs.0 Request processed in 190us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844800.427604:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00080000:1.0:1788844800.427679:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788844800.443225:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844800.712522:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844800.713837:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244870144 00000100:00100000:0.0:1788844800.713855:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244870144 00000100:00100000:0.0:1788844800.714015:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 92 00000100:00100000:0.0:1788844800.714028:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+10:13885:x1875739244870144:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788844800.714051:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844800.714077:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0031c00/0x7f1093851e2da669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793fd4d expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844800.714201:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0031c00/0x7f1093851e2da669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd4d expref: 11 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844800.714216:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0031c00/0x7f1093851e2da669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd4d expref: 11 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844800.714236:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0031c00, rc 0) 00000100:00100000:0.0:1788844800.714326:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+11:13885:x1875739244870144:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 300us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844800.714333:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 92 00000100:00100000:0.0:1788844800.718376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844800.718524:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244870272 00000100:00100000:3.0:1788844800.718580:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244870272 00000100:00100000:3.0:1788844800.718652:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:3.0:1788844800.718665:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+11:13885:x1875739244870272:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788844800.719091:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+11:13885:x1875739244870272:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 426us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844800.719101:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 93 00000100:00100000:2.0:1788844800.721968:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844800.722247:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244870400 00000100:00100000:0.0:1788844800.722263:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244870400 00000100:00100000:0.0:1788844800.722336:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:0.0:1788844800.722347:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+11:13885:x1875739244870400:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788844800.722870:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+11:13885:x1875739244870400:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 521us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844800.722887:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 94 00000100:00100000:2.0:1788844800.735178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.735328:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244870528 00000100:00100000:1.0:1788844800.735345:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244870528 00000100:00100000:1.0:1788844800.735433:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 95 00000100:00100000:1.0:1788844800.735444:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+11:13891:x1875739244870528:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788844800.735878:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+11:13891:x1875739244870528:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 434us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844800.735889:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 95 00000100:00100000:2.0:1788844800.766487:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844800.767605:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244870656 00000100:00100000:0.0:1788844800.767628:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244870656 00000100:00100000:0.0:1788844800.767719:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 96 00000100:00100000:0.0:1788844800.767743:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+11:13891:x1875739244870656:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788844800.768178:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd329c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+11:13891:x1875739244870656:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 446us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844800.768189:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 96 00000100:00100000:2.0:1788844800.778103:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844800.778377:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244870784 00000100:00100000:3.0:1788844800.778404:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244870784 00000100:00100000:3.0:1788844800.778498:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 97 00000100:00100000:3.0:1788844800.778510:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+11:13885:x1875739244870784:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788844800.778532:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844800.778602:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec0024200/0x7f1093851e2da670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793fd77 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844800.778641:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec0024200/0x7f1093851e2da670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd77 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844800.778654:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec0024200/0x7f1093851e2da670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd77 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844800.778665:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024200, rc 0) 00000100:00100000:3.0:1788844800.778751:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd328450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+12:13885:x1875739244870784:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 242us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844800.778759:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 97 00000100:00100000:3.0:1788844800.787908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.788118:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244870912 00000100:00100000:1.0:1788844800.788135:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244870912 00000100:00100000:1.0:1788844800.788213:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00100000:1.0:1788844800.788236:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+12:13885:x1875739244870912:12345-192.168.204.43@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788844800.788275:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788844800.788308:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788844800.788318:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788844800.788321:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788844800.788324:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788844800.791869:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd329450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+12:13885:x1875739244870912:12345-192.168.204.43@tcp:256:mount.lustre.0 Request processed in 3627us (3959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844800.791889:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 98 00000100:00100000:2.0:1788844800.797286:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844800.797501:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244871040 00000100:00100000:0.0:1788844800.797516:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244871040 00000100:00100000:0.0:1788844800.797638:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:0.0:1788844800.797650:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+12:13885:x1875739244871040:12345-192.168.204.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788844800.797673:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844800.797698:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5527200/0x7f1093851e2da677 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793fd7e expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844800.797745:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5527200/0x7f1093851e2da677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd7e expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844800.797759:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5527200/0x7f1093851e2da677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd7e expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844800.797771:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527200, rc 0) 00000100:00100000:0.0:1788844800.798076:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd329050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+13:13885:x1875739244871040:12345-192.168.204.43@tcp:101:mount.lustre.0 Request processed in 427us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844800.798085:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 99 00000100:00100000:3.0:1788844800.801678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.807675:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244871168 00000100:00100000:1.0:1788844800.807698:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244871168 00000100:00100000:1.0:1788844800.807820:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:1.0:1788844800.807836:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefd32a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+13:13885:x1875739244871168:12345-192.168.204.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788844800.808966:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefd32a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+13:13885:x1875739244871168:12345-192.168.204.43@tcp:501:mount.lustre.0 Request processed in 1122us (7288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844800.808980:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 100 00000100:00100000:2.0:1788844800.820911:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.823614:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244871296 00000100:00100000:1.0:1788844800.823636:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244871296 00000100:00100000:0.0:1788844800.823825:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:0.0:1788844800.823840:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+13:13885:x1875739244871296:12345-192.168.204.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788844800.824193:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+13:13885:x1875739244871296:12345-192.168.204.43@tcp:503:mount.lustre.0 Request processed in 356us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844800.824203:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 101 00000100:00100000:2.0:1788844800.829520:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.830221:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244871424 00000100:00100000:1.0:1788844800.830247:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244871424 00000100:00100000:1.0:1788844800.830335:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 102 00000100:00100000:1.0:1788844800.830348:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+13:13894:x1875739244871424:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788844800.830921:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb621450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+13:13894:x1875739244871424:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 573us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844800.830931:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 102 00000100:00100000:2.0:1788844800.834675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844800.834923:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244871552 00000100:00100000:3.0:1788844800.834940:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244871552 00000100:00100000:3.0:1788844800.835046:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 103 00000100:00100000:3.0:1788844800.835059:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+13:13894:x1875739244871552:12345-192.168.204.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788844800.835415:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb622c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+13:13894:x1875739244871552:12345-192.168.204.43@tcp:502:llog_process_th.0 Request processed in 358us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844800.835425:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 103 00000100:00100000:2.0:1788844800.872465:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.872898:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244871680 00000100:00100000:1.0:1788844800.872913:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244871680 00000100:00100000:2.0:1788844800.873086:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:2.0:1788844800.873098:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1875739244871680:12345-192.168.204.43@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788844800.873141:0:14359:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8582c8d7-7a12-4999-a23d-58ee6d4bb16b@192.168.204.43@tcp t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:2.0:1788844800.873196:0:14359:0:(genops.c:1385:class_connect()) connect: client 8582c8d7-7a12-4999-a23d-58ee6d4bb16b, cookie 0x7f1093851e2da67e 00000004:00100000:2.0:1788844800.873396:0:14359:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788844800.873592:0:14359:0:(import.c:65:import_set_state_nolock()) ffff91eef7f4f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788844800.873741:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:2353:x1875739244871680:12345-192.168.204.43@tcp:38:mount.lustre.0 Request processed in 634us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844800.873771:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:2.0:1788844800.894633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844800.894802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.900838:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244871936 00000100:00100000:1.0:1788844800.900864:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244871936 00000100:00100000:1.0:1788844800.901075:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244871808 00000100:00100000:1.0:1788844800.901080:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244871808 00000100:00100000:1.0:1788844800.901292:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:1.0:1788844800.901304:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+7:13885:x1875739244871936:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788844800.901363:0:14358:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788844800.901478:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+7:13885:x1875739244871936:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 175us (6861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844800.901487:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:1.0:1788844800.901510:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:1.0:1788844800.901517:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:0:x1875739244871808:12345-192.168.204.43@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788844800.901529:0:14358:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788844800.901584:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:0:x1875739244871808:12345-192.168.204.43@tcp:41:mount.lustre.0 Request processed in 67us (6781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844800.901590:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00080000:2.0:1788844800.905211:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788844800.906635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.906747:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244872064 00000100:00100000:1.0:1788844800.906760:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244872064 00000100:00100000:1.0:1788844800.906858:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1788844800.906869:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:13885:x1875739244872064:12345-192.168.204.43@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788844800.907003:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:13885:x1875739244872064:12345-192.168.204.43@tcp:40:mount.lustre.0 Request processed in 135us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844800.907011:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1788844800.920370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.920424:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.920460:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.920495:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.920523:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844800.920604:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244872832 00000100:00100000:1.0:1788844800.920637:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244872832 00000100:00100000:1.0:1788844800.920701:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244872960 00000100:00100000:1.0:1788844800.920704:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244872960 00000100:00100000:1.0:1788844800.920724:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:1.0:1788844800.920746:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2357:x1875739244872832:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844800.920854:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2357:x1875739244872832:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 111us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844800.920863:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:1.0:1788844800.920883:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:1.0:1788844800.920890:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2357:x1875739244872960:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844800.920918:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2357:x1875739244872960:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 28us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844800.920925:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:0.0:1788844800.921089:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244872448 00000100:00100000:0.0:1788844800.921096:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244872448 00000100:00100000:0.0:1788844800.921141:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:0.0:1788844800.921148:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:13885:x1875739244872448:12345-192.168.204.43@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788844800.921255:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788844800.921345:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:13885:x1875739244872448:12345-192.168.204.43@tcp:33:mount.lustre.0 Request processed in 197us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844800.921353:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:3.0:1788844800.921575:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244872704 00000100:00100000:3.0:1788844800.921582:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244872704 00000100:00100000:3.0:1788844800.921626:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1788844800.921633:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:2357:x1875739244872704:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844800.921665:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:2357:x1875739244872704:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 33us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844800.921673:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:3.0:1788844800.921694:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244872576 00000100:00100000:3.0:1788844800.921699:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244872576 00000100:00100000:3.0:1788844800.921722:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:3.0:1788844800.921739:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+13:2357:x1875739244872576:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844800.921766:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb621050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+13:2357:x1875739244872576:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 38us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844800.921774:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 104 00000100:00100000:2.0:1788844800.926825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844800.926879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844800.927805:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244872192 00000100:00100000:0.0:1788844800.927822:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244872192 00000100:00100000:0.0:1788844800.927917:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244872320 00000100:00100000:0.0:1788844800.927921:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244872320 00000100:00100000:0.0:1788844800.927943:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1788844800.927952:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875739244872192:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788844800.927997:0:15043:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8582c8d7-7a12-4999-a23d-58ee6d4bb16b@192.168.204.43@tcp t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1788844800.928044:0:15043:0:(genops.c:1385:class_connect()) connect: client 8582c8d7-7a12-4999-a23d-58ee6d4bb16b, cookie 0x7f1093851e2da685 00002000:00100000:0.0:1788844800.928061:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8582c8d7-7a12-4999-a23d-58ee6d4bb16b/ffff91eef4b2d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788844800.928080:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788844800.928258:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788844800.928300:0:15043:0:(import.c:65:import_set_state_nolock()) ffff91eef4b2f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844800.928432:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:2353:x1875739244872192:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 478us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844800.928440:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1788844800.928465:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:0.0:1788844800.928471:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875739244872320:12345-192.168.204.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788844800.928489:0:15043:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8582c8d7-7a12-4999-a23d-58ee6d4bb16b@192.168.204.43@tcp t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1788844800.928510:0:15043:0:(genops.c:1385:class_connect()) connect: client 8582c8d7-7a12-4999-a23d-58ee6d4bb16b, cookie 0x7f1093851e2da68c 00002000:00100000:0.0:1788844800.928516:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8582c8d7-7a12-4999-a23d-58ee6d4bb16b/ffff91eef4b29000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788844800.928524:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788844800.928663:0:15043:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788844800.928678:0:15043:0:(import.c:65:import_set_state_nolock()) ffff91eef4b2d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788844800.928701:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:2353:x1875739244872320:12345-192.168.204.43@tcp:8:mount.lustre.0 Request processed in 229us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844800.928707:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:2.0:1788844801.138133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844801.138296:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244873088 00000100:00100000:1.0:1788844801.138312:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244873088 00000100:00100000:1.0:1788844801.138404:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:1.0:1788844801.138418:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:13915:x1875739244873088:12345-192.168.204.43@tcp:101:mkdir.0 00010000:00010000:1.0:1788844801.138447:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844801.138481:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fda8 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844801.138617:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844801.138636:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844801.138653:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844801.138714:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788844801.138718:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844801.138751:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844801.138782:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fda8 expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844801.139463:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fda8 expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844801.139474:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796800) 00010000:00010000:1.0:1788844801.139478:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788844801.139482:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61e00, rc 0) 00000100:00100000:1.0:1788844801.139739:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+7:13915:x1875739244873088:12345-192.168.204.43@tcp:101:mkdir.0 Request processed in 1312us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844801.139748:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:1.0:1788844801.274660:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788844801.274694:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267935744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844801.274814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844801.275353:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267935744 00000100:00100000:2.0:1788844801.275365:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267935744 00000100:00100000:2.0:1788844801.275471:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788844801.275484:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267935744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844801.275515:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788844801.275623:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267935744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844801.275631:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788844801.275903:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788844801.275961:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267935744:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788844801.465849:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844802.494886:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788844802.895955:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8582c8d7-7a12-4999-a23d-58ee6d4bb16b 00000001:00100000:0.0:1788844802.897168:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39 00000001:00100000:3.0:1788844803.488076:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ec5eacc-9ecf-4b3d-902b-23c3d0acea39 00000001:00100000:3.0:1788844803.488098:0:5861:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8582c8d7-7a12-4999-a23d-58ee6d4bb16b 00010000:00010000:2.0:1788844803.516411:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844803.833784:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267936000:0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.833883:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844803.833958:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267936512:0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.833991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844803.834025:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844803.834033:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875739267936384:0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.834072:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844803.834108:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267936128:0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.834142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844803.834159:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267936640:0@lo:400:kworker.0 00000100:00100000:0.0:1788844803.834203:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267936512 00000100:00100000:0.0:1788844803.834214:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267936512 00000100:00100000:3.0:1788844803.834219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844803.834241:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788844803.834255:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ef0170b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267936256:0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.834279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844803.834291:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267936384 00000100:00100000:0.0:1788844803.834294:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267936384 00000100:00100000:3.0:1788844803.834296:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267935872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844803.834307:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267936640 00000100:00100000:0.0:1788844803.834310:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267936640 00000100:00100000:3.0:1788844803.834317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844803.834329:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788844803.834339:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267936512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.834347:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788844803.834356:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788844803.834371:0:14358:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788844803.834380:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788844803.834386:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef01709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875739267936384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844803.834405:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267936512:12345-0@lo:400:kworker.0 Request processed in 67us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844803.834415:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef01709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875739267936384:12345-0@lo:400:kworker.0 Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844803.834420:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788844803.834438:0:14359:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788844803.834479:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267936000 00000100:00100000:2.0:1788844803.834484:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267936000 00000100:00100000:2.0:1788844803.834517:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788844803.834524:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267936000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844803.834574:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb623c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267936000:12345-0@lo:400:kworker.0 Request processed in 51us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844803.834581:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788844803.843647:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788844803.843721:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788844803.843742:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267936640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.843874:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267936640:12345-0@lo:400:kworker.0 Request processed in 142us (9651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844803.843882:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788844803.843909:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267936128 00000100:00100000:3.0:1788844803.843919:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267936128 00000100:00100000:3.0:1788844803.843971:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267936256 00000100:00100000:3.0:1788844803.843975:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267936256 00000100:00100000:3.0:1788844803.843995:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788844803.844002:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267936128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844803.844519:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788844803.844534:0:15043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1788844803.844565:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844803.844570:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844803.844573:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844803.844806:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875739267936384:0@lo:400:kworker.0 00000100:00100000:0.0:1788844803.844824:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267936000:0@lo:400:kworker.0 00000100:00100000:0.0:1788844803.844839:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267936512:0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.848439:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267936128:12345-0@lo:400:kworker.0 Request processed in 37us (9895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844803.848475:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788844803.848521:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788844803.848561:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267936256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.848695:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267936256:12345-0@lo:400:kworker.0 Request processed in 164us (14414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844803.848702:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788844803.848729:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267935872 00000100:00100000:3.0:1788844803.848739:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267935872 00000100:00100000:3.0:1788844803.848778:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788844803.848785:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267935872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844803.848816:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844803.848852:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267935872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (14534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844803.848858:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788844803.851704:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788844803.851743:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267936256:0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.851782:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267935872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844803.851798:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef01709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267936128:0@lo:400:kworker.0 00000100:00100000:3.0:1788844803.851813:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ef0170a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267936640:0@lo:400:kworker.0 00000001:00100000:3.0:1788844803.902483:0:7640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8582c8d7-7a12-4999-a23d-58ee6d4bb16b 00010000:00010000:0.0:1788844804.537736:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788844804.703014:0:16326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788844805.561975:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844806.096520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844806.096595:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844806.096643:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844806.096681:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844806.096740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844806.096758:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244873600 00000100:00100000:1.0:1788844806.096762:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844806.096773:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244873600 00000100:00100000:1.0:1788844806.096786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844806.096808:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244873856 00000100:00100000:1.0:1788844806.096812:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244873856 00000100:00100000:1.0:1788844806.096841:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244873472 00000100:00100000:0.0:1788844806.096842:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244873984 00000100:00100000:1.0:1788844806.096844:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244873472 00000100:00100000:0.0:1788844806.096844:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244873984 00000100:00100000:0.0:1788844806.096861:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1788844806.096885:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2355:x1875739244873600:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844806.097001:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2355:x1875739244873600:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 118us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844806.103120:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:1.0:1788844806.103160:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2355:x1875739244873856:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844806.103668:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1788844806.103824:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:0.0:1788844806.103838:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2355:x1875739244873984:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844806.104252:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2355:x1875739244873984:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 417us (7461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844806.104261:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:0.0:1788844806.104297:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1788844806.104306:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2355:x1875739244873472:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844806.104338:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2355:x1875739244873472:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 34us (7598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844806.104345:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1788844806.104378:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244873344 00000100:00100000:0.0:1788844806.104390:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244873344 00000100:00100000:0.0:1788844806.104441:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244873728 00000100:00100000:0.0:1788844806.104446:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244873728 00000100:00100000:0.0:1788844806.104481:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:0.0:1788844806.104489:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2355:x1875739244873344:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844806.104521:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2355:x1875739244873344:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 33us (8022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844806.104529:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:1.0:1788844806.104749:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2355:x1875739244873856:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 1611us (8119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844806.104759:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:3.0:1788844806.105016:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:3.0:1788844806.105028:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:2355:x1875739244873728:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844806.105075:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:2355:x1875739244873728:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 50us (8311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844806.105082:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1788844806.105778:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244873216 00000100:00100000:0.0:1788844806.105790:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244873216 00000100:00100000:0.0:1788844806.105839:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 106 00000100:00100000:0.0:1788844806.105848:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+13:2355:x1875739244873216:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844806.105905:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb621850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+13:2355:x1875739244873216:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 59us (9223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844806.105913:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 106 00000100:00080000:0.0:1788844806.105958:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788844806.105965:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788844806.105969:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788844806.394813:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788844806.394845:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267936768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788844806.395177:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844806.395761:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267936768 00000100:00100000:3.0:1788844806.395773:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267936768 00000100:00100000:3.0:1788844806.395867:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788844806.397316:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267936768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788844806.397376:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788844806.397637:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844806.402074:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267936768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4757us (6875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844806.402095:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788844806.416102:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267936768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788844806.586066:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844807.613474:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788844807.998909:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788844808.637281:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844808.956678:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267936896:0@lo:400:kworker.0 00000100:00100000:1.0:1788844808.956775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844808.956849:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267937536:0@lo:400:kworker.0 00000100:00100000:1.0:1788844808.956881:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844808.956912:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788844808.956919:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875739267937280:0@lo:400:kworker.0 00000100:00100000:2.0:1788844808.956968:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267936896 00000100:00100000:2.0:1788844808.956990:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267936896 00000100:00100000:2.0:1788844808.957049:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788844808.957059:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267936896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844808.957130:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb623450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267936896:12345-0@lo:400:kworker.0 Request processed in 72us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844808.957137:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788844808.957220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844808.957451:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267937024:0@lo:400:kworker.0 00000100:00100000:0.0:1788844808.957494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844808.957522:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267937408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844808.957595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844808.957648:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267936896:0@lo:400:kworker.0 00000100:00100000:0.0:1788844808.957706:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788844808.957718:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267937152:0@lo:400:kworker.0 00000100:00100000:0.0:1788844808.957749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844808.957769:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267937664:0@lo:400:kworker.0 00000100:00100000:0.0:1788844808.957796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844808.958530:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267937024 00000100:00100000:0.0:1788844808.958563:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267937024 00000100:00100000:0.0:1788844808.958629:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267937152 00000100:00100000:0.0:1788844808.958633:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267937152 00000100:00100000:0.0:1788844808.958660:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788844808.958669:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267937024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844808.958730:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267937024:12345-0@lo:400:kworker.0 Request processed in 62us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844808.958737:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788844808.958752:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788844808.958763:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb393b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267937152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844808.958790:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb393b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267937152:12345-0@lo:400:kworker.0 Request processed in 33us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844808.958796:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788844808.958863:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267937536 00000100:00100000:2.0:1788844808.958868:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267937536 00000100:00100000:2.0:1788844808.958951:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267937280 00000100:00100000:2.0:1788844808.958955:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267937280 00000100:00100000:2.0:1788844808.958967:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267937664 00000100:00100000:2.0:1788844808.958969:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267937664 00000100:00100000:2.0:1788844808.958982:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788844808.958988:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267937536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844808.959014:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788844808.959029:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875739267937280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844808.959035:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267937536:12345-0@lo:400:kworker.0 Request processed in 45us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844808.959042:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788844808.959057:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788844808.959078:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875739267937280:12345-0@lo:400:kworker.0 Request processed in 54us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844808.959085:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788844808.959118:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267937408 00000100:00100000:1.0:1788844808.959122:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267937408 00000100:00100000:2.0:1788844808.959132:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267937664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844808.959155:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788844808.959166:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267937408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788844808.959171:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267937664:12345-0@lo:400:kworker.0 Request processed in 106us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844808.959179:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00002000:00000024:1.0:1788844808.959203:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788844808.959241:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844808.959247:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267937408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1651us total) trans 0 rc 0/0 00000100:00080000:0.0:1788844808.959249:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844808.959253:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788844808.959257:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788844808.959297:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267937664:0@lo:400:kworker.0 00000100:00100000:1.0:1788844808.959319:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875739267937280:0@lo:400:kworker.0 00000100:00100000:0.0:1788844808.959320:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267937024:0@lo:400:kworker.0 00000100:00100000:1.0:1788844808.959342:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267937536:0@lo:400:kworker.0 00000100:00100000:0.0:1788844808.959353:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267937408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788844808.959382:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267937152:0@lo:400:kworker.0 00000020:00000080:3.0:1788844809.126734:0:16475:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf8aff230 20000000:00000080:3.0:1788844809.126762:0:16475:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91ef01ad1800 uarg=0000000000000000 20000000:01000000:3.0:1788844809.126821:0:16475:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788844809.126829:0:16475:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788844809.126836:0:16475:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788844809.128452:0:16476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788844809.129010:0:16475:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788844809.153168:0:16475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788844809.153207:0:16475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153229:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed0d64000/0x7f1093851e2da398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da391 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153238:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0024e00/0x7f1093851e2da3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da3de expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153246:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eed0d60000/0x7f1093851e2da519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da512 expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153255:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec0031800/0x7f1093851e2da63f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd1c expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153262:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91eec5527200/0x7f1093851e2da677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd7e expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153286:0:16475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153337:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec5527200/0x7f1093851e2da677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd7e expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153351:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eec5527200/0x7f1093851e2da677 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd7e expref: 12 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844809.153366:0:16475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875739267937792:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844809.153503:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0031800/0x7f1093851e2da63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd1c expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153513:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eec0031800/0x7f1093851e2da63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd1c expref: 12 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844809.153522:0:16475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875739267937920:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844809.153678:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed0d60000/0x7f1093851e2da519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2da512 expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153687:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eed0d60000/0x7f1093851e2da519 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2da512 expref: 18 pid: 14352 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844809.153698:0:16475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875739267938048:0@lo:104: 00000100:00100000:1.0:1788844809.153756:0:16475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788844809.153803:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eec0024e00/0x7f1093851e2da3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2da3de expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153823:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eec0024e00/0x7f1093851e2da3e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2da3de expref: 18 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844809.153834:0:16475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875739267938176:0@lo:104: 00000100:00100000:1.0:1788844809.153858:0:16475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788844809.153895:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91eed0d64000/0x7f1093851e2da398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7f1093851e2da391 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.153904:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91eed0d64000/0x7f1093851e2da398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7f1093851e2da391 expref: 18 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844809.153912:0:16475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff834380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875739267938304:0@lo:104: 00000100:00100000:1.0:1788844809.153939:0:16475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844809.153956:0:16475:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ef019b8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788844809.154174:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788844809.154203:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267938048 00000100:00100000:2.0:1788844809.154215:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267938048 00000100:00100000:2.0:1788844809.154287:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267938176 00000100:00100000:2.0:1788844809.154291:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267938176 00000100:00100000:2.0:1788844809.154304:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267938304 00000100:00100000:2.0:1788844809.154316:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267938304 00000100:00100000:2.0:1788844809.154337:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788844809.154347:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:661a174e-3914-46cb-b31b-f72a0fba243b+5:16475:x1875739267938048:12345-0@lo:104: 00010000:00010000:2.0:1788844809.154366:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.154469:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788844809.154477:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:661a174e-3914-46cb-b31b-f72a0fba243b+5:16475:x1875739267938048:12345-0@lo:104: Request processed in 131us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844809.154485:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788844809.154505:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844809.154511:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:661a174e-3914-46cb-b31b-f72a0fba243b+4:16475:x1875739267938176:12345-0@lo:104: 00010000:00010000:2.0:1788844809.154519:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.154612:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788844809.154617:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:661a174e-3914-46cb-b31b-f72a0fba243b+4:16475:x1875739267938176:12345-0@lo:104: Request processed in 107us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844809.154624:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844809.154635:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788844809.154641:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ef013e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:661a174e-3914-46cb-b31b-f72a0fba243b+3:16475:x1875739267938304:12345-0@lo:104: 00010000:00010000:2.0:1788844809.154649:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.154689:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788844809.154694:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ef013e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:661a174e-3914-46cb-b31b-f72a0fba243b+3:16475:x1875739267938304:12345-0@lo:104: Request processed in 54us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844809.154712:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788844809.154784:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788844809.154792:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.154802:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170cc00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844809.154807:0:14346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.154818:0:14346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844809.154826:0:14346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844809.154833:0:14346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788844809.154876:0:14346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.154884:0:14346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844809.154913:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.154921:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91ef0170cc00/0x7f1093851e2da512 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da519 expref: -99 pid: 15763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.154936:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788844809.154939:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.154946:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61a00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844809.154949:0:14346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.154963:0:14346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844809.154970:0:14346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844809.154976:0:14346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788844809.155013:0:14346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155021:0:14346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844809.155029:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155035:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eed0d61a00/0x7f1093851e2da3de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da3e5 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155045:0:14346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788844809.155048:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155054:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d64c00 already unused, calling callback (ffffffffc1dafc20) 10000000:00010000:2.0:1788844809.155057:0:14346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155064:0:14346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788844809.155070:0:14346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788844809.155082:0:14346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788844809.155097:0:14346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155104:0:14346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788844809.155121:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155128:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.143@tcp lock: ffff91eed0d64c00/0x7f1093851e2da391 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7f1093851e2da398 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155153:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844809.155157:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844809.155160:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844809.155172:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788844809.155180:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788844809.155194:0:16475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875739267938048:0@lo:104: 00000100:00100000:2.0:1788844809.155199:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267938560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788844809.155216:0:16475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875739267938176:0@lo:104: 00000100:00100000:1.0:1788844809.155227:0:16475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff834380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875739267938304:0@lo:104: 00000100:00100000:2.0:1788844809.155263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844809.155317:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788844809.155324:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267938432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788844809.155348:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844809.155375:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788844809.155384:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:661a174e-3914-46cb-b31b-f72a0fba243b:3306:1875739267938688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788844809.155411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844809.155443:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267938560 00000100:00100000:2.0:1788844809.155449:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267938560 00010000:00010000:2.0:1788844809.155472:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0024e00/0x7f1093851e2da3e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da3de expref: 19 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844809.155503:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267938432 00000100:00100000:2.0:1788844809.155507:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267938432 00010000:00010000:2.0:1788844809.155519:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed0d60000/0x7f1093851e2da519 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da512 expref: 20 pid: 14352 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844809.155530:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267938688 00000100:00100000:2.0:1788844809.155533:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267938688 00010000:00010000:2.0:1788844809.155585:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eed0d64000/0x7f1093851e2da398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da391 expref: 21 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844809.155604:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788844809.155611:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:661a174e-3914-46cb-b31b-f72a0fba243b+21:3308:x1875739267938560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788844809.155624:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844809.155630:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0024e00/0x7f1093851e2da3e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da3de expref: 21 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155640:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0024e00/0x7f1093851e2da3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2da3de expref: 21 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155657:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0024e00/0x7f1093851e2da3e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2da3de expref: 21 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155672:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844809.155704:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:661a174e-3914-46cb-b31b-f72a0fba243b+20:3308:x1875739267938560:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844809.155710:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788844809.155723:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844809.155728:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267938432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788844809.155743:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844809.155747:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed0d60000/0x7f1093851e2da519 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da512 expref: 19 pid: 14352 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155755:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed0d60000/0x7f1093851e2da519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2da512 expref: 19 pid: 14352 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155765:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed0d60000/0x7f1093851e2da519 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2da512 expref: 19 pid: 14352 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155775:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844809.155795:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:661a174e-3914-46cb-b31b-f72a0fba243b+18:3308:x1875739267938432:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844809.155801:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788844809.155816:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788844809.155821:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:661a174e-3914-46cb-b31b-f72a0fba243b+17:3306:x1875739267938688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788844809.155829:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844809.155833:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eed0d64000/0x7f1093851e2da398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7f1093851e2da391 expref: 17 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155841:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eed0d64000/0x7f1093851e2da398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7f1093851e2da391 expref: 17 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155852:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed0d64000/0x7f1093851e2da398 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7f1093851e2da391 expref: 17 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.155861:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844809.155886:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:661a174e-3914-46cb-b31b-f72a0fba243b+16:3306:x1875739267938688:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844809.155902:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788844809.155966:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:661a174e-3914-46cb-b31b-f72a0fba243b:3306:1875739267938688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788844809.155994:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267938432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788844809.156002:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267938560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788844809.162039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844809.162161:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844809.162201:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244874112 00000100:00100000:2.0:1788844809.162214:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244874112 00010000:00010000:2.0:1788844809.162266:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec5527200/0x7f1093851e2da677 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd7e expref: 13 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844809.162305:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244874240 00000100:00100000:2.0:1788844809.162309:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244874240 00010000:00010000:2.0:1788844809.162323:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91eec0031800/0x7f1093851e2da63f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd1c expref: 14 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844809.162340:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:2.0:1788844809.162349:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43808ea0-7b80-4845-b465-28f13dbe0884+14:2355:x1875739244874112:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844809.162369:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844809.162376:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec5527200/0x7f1093851e2da677 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd7e expref: 14 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.162390:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec5527200/0x7f1093851e2da677 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd7e expref: 14 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844809.162420:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844809.162686:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788844809.162699:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788844809.162926:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec5527200/0x7f1093851e2da677 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd7e expref: 14 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844809.162947:0:16475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875739267937792:192.168.204.43@tcp:104: 00000100:00100000:3.0:1788844809.162962:0:16475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875739267937920:192.168.204.43@tcp:104: 00010000:00010000:3.0:1788844809.163015:0:16475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844809.163485:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:1.0:1788844809.163501:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43808ea0-7b80-4845-b465-28f13dbe0884+13:2355:x1875739244874240:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788844809.163517:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844809.163525:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91eec0031800/0x7f1093851e2da63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd1c expref: 13 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163592:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91eec0031800/0x7f1093851e2da63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd1c expref: 13 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163622:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eec0031800/0x7f1093851e2da63f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd1c expref: 13 pid: 14353 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163640:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163651:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163667:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163674:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163682:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163690:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163697:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60c00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844809.163702:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163711:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163729:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844809.163736:0:16475:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844809.163754:0:16475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844809.163760:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844809.163762:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91eed0d60c00/0x7f1093851e2da6a1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844809.163861:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43808ea0-7b80-4845-b465-28f13dbe0884+12:2355:x1875739244874240:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 355us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844809.163870:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:2.0:1788844809.164793:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43808ea0-7b80-4845-b465-28f13dbe0884+11:2355:x1875739244874112:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 2410us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844809.164803:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00010000:00010000:2.0:1788844809.664504:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788844810.363410:0:14355:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788844810.363421:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eef3795000 from 10 10000000:01000000:0.0:1788844810.363429:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788844810.363494:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2da6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.363507:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2da6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.363520:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2da6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844810.363589:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267938816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788844810.363682:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844810.363937:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844810.365972:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267938816 00000100:00100000:1.0:1788844810.365995:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267938816 00000100:00100000:1.0:1788844810.366079:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788844810.366093:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+16:14355:x1875739267938816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788844810.366115:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844810.366140:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da6af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da6a8 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844810.366173:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da6a8 expref: 17 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844810.366186:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eed0d60400/0x7f1093851e2da6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da6a8 expref: 17 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844810.366196:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60400, rc 0) 00000100:00100000:1.0:1788844810.366297:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb622050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+17:14355:x1875739267938816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (2614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844810.366305:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788844810.366946:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267938816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844810.366971:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2da6a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da6af expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.366995:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2da6a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da6af expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844810.367098:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267938944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844810.367149:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844810.367198:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844810.367335:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267938944 00000100:00100000:2.0:1788844810.367342:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267938944 00000100:00100000:2.0:1788844810.367398:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788844810.367407:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+17:14355:x1875739267938944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844810.367761:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb623050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+17:14355:x1875739267938944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844810.367769:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788844810.368949:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267938944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844810.369021:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844810.369100:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844810.369149:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788844810.369234:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267939072 00000100:00100000:2.0:1788844810.369242:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267939072 00000100:00100000:2.0:1788844810.369435:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788844810.369448:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+17:14355:x1875739267939072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844810.369739:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb622450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+17:14355:x1875739267939072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 293us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844810.370314:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788844810.371286:0:16512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788844810.371578:0:14355:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788844810.371611:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788844810.371626:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2da6a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da6af expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844810.371652:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eec5526400/0x7f1093851e2da6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da6af expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844810.371664:0:14355:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788844810.371668:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eec57c5800 from 10 10000000:01000000:1.0:1788844810.371672:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788844810.371722:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d61000/0x7f1093851e2da6b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844810.371731:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed0d61000/0x7f1093851e2da6b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844810.371743:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed0d61000/0x7f1093851e2da6b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844810.371770:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788844810.371862:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844810.371911:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6bb29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844810.376594:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267939200 00000100:00100000:0.0:1788844810.376619:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267939200 00000100:00100000:0.0:1788844810.376679:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788844810.376692:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+18:14355:x1875739267939200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844810.376717:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844810.376744:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5527000/0x7f1093851e2da6bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da6b6 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.376784:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5527000/0x7f1093851e2da6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da6b6 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.376798:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5527000/0x7f1093851e2da6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da6b6 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.376810:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527000, rc 0) 00000100:00100000:0.0:1788844810.377795:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb622850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:14355:x1875739267939200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1099us (5926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844810.377813:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788844810.379098:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844810.379138:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed0d61000/0x7f1093851e2da6b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da6bd expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.379154:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed0d61000/0x7f1093851e2da6b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da6bd expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844810.379263:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb393480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844810.379500:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788844810.379706:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844810.379761:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788844810.379786:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267939328 00000100:00100000:0.0:1788844810.379795:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267939328 00000100:00100000:0.0:1788844810.380618:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788844810.380636:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+18:14355:x1875739267939328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844810.381377:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb620450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+18:14355:x1875739267939328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 742us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844810.381511:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788844810.381787:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb393480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844810.381870:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844810.381949:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844810.381990:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6bb2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788844810.382268:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267939456 00000100:00100000:2.0:1788844810.382277:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267939456 00000100:00100000:2.0:1788844810.382336:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788844810.382345:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+18:14355:x1875739267939456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844810.382611:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb620050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:661a174e-3914-46cb-b31b-f72a0fba243b+18:14355:x1875739267939456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844810.382619:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788844810.382849:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788844810.387148:0:16514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788844810.397623:0:14355:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788844810.397673:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788844810.397690:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d61000/0x7f1093851e2da6b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da6bd expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844810.397722:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed0d61000/0x7f1093851e2da6b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da6bd expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788844810.397736:0:14355:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788844810.397739:0:14355:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91eed0770000 from 10 10000000:01000000:1.0:1788844810.397743:0:14355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788844810.397800:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d60e00/0x7f1093851e2da6c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844810.397808:0:14355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.143@tcp lock: ffff91eed0d60e00/0x7f1093851e2da6c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844810.397832:0:14355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.143@tcp lock: ffff91eed0d60e00/0x7f1093851e2da6c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844810.397868:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788844810.397979:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844810.398318:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267939584 00000100:00100000:0.0:1788844810.398330:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267939584 00000100:00100000:0.0:1788844810.398391:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788844810.398402:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+18:14355:x1875739267939584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844810.398421:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844810.398438:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91eec5526c00/0x7f1093851e2da6cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f1093851e2da6c4 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.398483:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91eec5526c00/0x7f1093851e2da6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7f1093851e2da6c4 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.398497:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91eec5526c00/0x7f1093851e2da6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7f1093851e2da6c4 expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.398508:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526c00, rc 0) 00000100:00100000:0.0:1788844810.398590:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb620850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:14355:x1875739267939584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844810.398598:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788844810.398749:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6bb2300 going to sleep for 11 seconds 00000100:00100000:0.0:1788844810.399186:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788844810.399214:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.143@tcp lock: ffff91eed0d60e00/0x7f1093851e2da6c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da6cb expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844810.399226:0:14355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.143@tcp lock: ffff91eed0d60e00/0x7f1093851e2da6c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7f1093851e2da6cb expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844810.399338:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788844810.399386:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844810.399431:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eeff3d0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788844810.399631:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267939712 00000100:00100000:2.0:1788844810.399639:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267939712 00000100:00100000:2.0:1788844810.399698:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788844810.399707:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:14355:x1875739267939712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844810.400128:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb621c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:14355:x1875739267939712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 421us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844810.400137:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788844810.400634:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844810.400694:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788844810.400751:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844810.400780:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6bb2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788844810.400853:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267939840 00000100:00100000:0.0:1788844810.400859:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267939840 00000100:00100000:0.0:1788844810.400903:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788844810.400923:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:14355:x1875739267939840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844810.401497:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb620c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:14355:x1875739267939840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 574us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844810.401517:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788844810.401618:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:661a174e-3914-46cb-b31b-f72a0fba243b:14355:1875739267939840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788844810.407661:0:16515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788844810.409192:0:14355:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788844810.409232:0:14355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788844810.409250:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.143@tcp lock: ffff91eed0d60e00/0x7f1093851e2da6c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da6cb expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844810.409266:0:14355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.143@tcp lock: ffff91eed0d60e00/0x7f1093851e2da6c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7f1093851e2da6cb expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844810.687049:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844810.885754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844810.885809:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244874368 00000100:00100000:2.0:1788844810.885823:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244874368 00000100:00100000:2.0:1788844810.885899:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:2.0:1788844810.885911:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+11:13769:x1875739244874368:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844810.885935:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844810.885964:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ef0170d000/0x7f1093851e2da6d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793fdaf expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844810.886005:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0170d000/0x7f1093851e2da6d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdaf expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844810.886022:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ef0170d000/0x7f1093851e2da6d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdaf expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844810.886051:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0170d000, rc 0) 00000100:00100000:2.0:1788844810.887823:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+12:13769:x1875739244874368:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 1899us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844810.887836:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 117 00000100:00100000:1.0:1788844810.898827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844810.899257:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244874496 00000100:00100000:2.0:1788844810.899273:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244874496 00000100:00100000:2.0:1788844810.899465:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:2.0:1788844810.899480:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+12:13769:x1875739244874496:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788844810.899924:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+12:13769:x1875739244874496:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 446us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844810.899933:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 118 00000100:00100000:1.0:1788844810.912481:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844810.913602:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244874624 00000100:00100000:2.0:1788844810.913619:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244874624 00000100:00100000:2.0:1788844810.913695:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:2.0:1788844810.913707:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+12:13769:x1875739244874624:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788844810.914013:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+12:13769:x1875739244874624:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 306us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844810.914022:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 119 00000100:00100000:2.0:1788844810.920798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844810.920846:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244874752 00000100:00100000:2.0:1788844810.920859:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244874752 00000100:00100000:2.0:1788844810.920924:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:2.0:1788844810.920936:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+12:13769:x1875739244874752:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788844810.920957:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844810.920990:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ef0170c600/0x7f1093851e2da6d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a22b62793fdb6 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844810.921028:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ef0170c600/0x7f1093851e2da6d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdb6 expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844810.921043:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ef0170c600/0x7f1093851e2da6d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdb6 expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844810.921055:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0170c600, rc 0) 00000100:00100000:2.0:1788844810.921154:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43808ea0-7b80-4845-b465-28f13dbe0884+13:13769:x1875739244874752:12345-192.168.204.43@tcp:101:ll_cfg_requeue.0 Request processed in 221us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844810.921162:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 120 00000100:00100000:1.0:1788844810.936764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844810.936822:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244874880 00000100:00100000:1.0:1788844810.936837:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244874880 00000100:00100000:1.0:1788844810.936925:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:1.0:1788844810.936939:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+13:13769:x1875739244874880:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788844810.937385:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+13:13769:x1875739244874880:12345-192.168.204.43@tcp:501:ll_cfg_requeue.0 Request processed in 449us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844810.937395:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 121 00000100:00100000:1.0:1788844810.943285:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844810.944118:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244875008 00000100:00100000:0.0:1788844810.944135:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244875008 00000100:00100000:0.0:1788844810.944532:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 122 00000100:00100000:0.0:1788844810.944571:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+13:13769:x1875739244875008:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788844810.944852:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43808ea0-7b80-4845-b465-28f13dbe0884+13:13769:x1875739244875008:12345-192.168.204.43@tcp:503:ll_cfg_requeue.0 Request processed in 284us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844810.944863:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 122 00000100:00100000:1.0:1788844811.203857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844811.203910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844811.203936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844811.203968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844811.203989:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844811.204017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844811.204055:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244875264 00000100:00100000:1.0:1788844811.204069:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244875264 00000100:00100000:1.0:1788844811.204138:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244875392 00000100:00100000:1.0:1788844811.204141:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244875392 00000100:00100000:1.0:1788844811.204156:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244875648 00000100:00100000:1.0:1788844811.204159:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244875648 00000100:00100000:1.0:1788844811.204174:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244875776 00000100:00100000:1.0:1788844811.204177:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244875776 00000100:00100000:1.0:1788844811.204195:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:1.0:1788844811.204206:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2356:x1875739244875264:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844811.204301:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2356:x1875739244875264:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 96us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844811.204310:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:1.0:1788844811.204330:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:1.0:1788844811.204348:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2357:x1875739244875392:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844811.204397:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2357:x1875739244875392:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 50us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844811.204404:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:1.0:1788844811.204417:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:1.0:1788844811.204424:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2357:x1875739244875648:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844811.204448:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2357:x1875739244875648:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844811.204455:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:1.0:1788844811.204466:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:1.0:1788844811.204473:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2356:x1875739244875776:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844811.204496:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2356:x1875739244875776:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 24us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844811.204503:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:1.0:1788844811.204585:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244875136 00000100:00100000:1.0:1788844811.204590:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244875136 00000100:00100000:1.0:1788844811.204621:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244875520 00000100:00100000:1.0:1788844811.204624:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244875520 00000100:00100000:1.0:1788844811.204643:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:1.0:1788844811.204650:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2357:x1875739244875136:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844811.204680:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2357:x1875739244875136:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 31us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844811.204689:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:1.0:1788844811.204701:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:1.0:1788844811.204707:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:2356:x1875739244875520:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844811.204740:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:2356:x1875739244875520:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 34us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844811.204746:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00080000:0.0:1788844811.205366:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788844811.205374:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844811.205376:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844811.513834:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267939968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788844811.513941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788844811.514187:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267939968 00000100:00100000:0.0:1788844811.514196:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267939968 00000100:00100000:0.0:1788844811.514267:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788844811.514277:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267939968:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788844811.514391:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788844811.514448:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788844811.514512:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267939968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 236us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844811.514520:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788844811.514640:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267939968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788844811.706351:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844812.487381:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844812.487526:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244875904 00000100:00100000:1.0:1788844812.487600:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244875904 00000100:00100000:1.0:1788844812.487801:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:1.0:1788844812.487814:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:14425:x1875739244875904:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788844812.487849:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844812.487879:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da6e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fdbd expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.487973:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da6e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.487991:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488007:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488023:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da6ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488030:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488037:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488523:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da6f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488574:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488584:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844812.488616:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788844812.488620:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844812.488679:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488692:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488699:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da6e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488706:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488714:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.488719:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488727:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da6e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488743:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796800) 00010000:00010000:1.0:1788844812.488752:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.488760:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da6e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488767:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da6e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488783:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da6ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488789:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da6ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488795:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da6ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488800:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.488803:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da6ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488810:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da6ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488818:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91eec7351700) 00010000:00010000:1.0:1788844812.488821:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.488825:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da6ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488836:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da6ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488879:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da6e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdbd expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488907:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61400/0x7f1093851e2da6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdbd expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.488927:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eec7351300) 00010000:00010000:1.0:1788844812.488930:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788844812.488932:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61400, rc 0) 00000100:00100000:1.0:1788844812.489028:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:14425:x1875739244875904:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1216us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844812.489036:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:1.0:1788844812.497970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844812.499137:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244876160 00000100:00100000:0.0:1788844812.499154:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244876160 00000100:00100000:0.0:1788844812.499248:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:0.0:1788844812.499261:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:14425:x1875739244876160:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788844812.499308:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844812.499335:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527400/0x7f1093851e2da6fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fdc4 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.499435:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da703 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.499469:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da703 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.499482:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da703 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.501436:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526200/0x7f1093851e2da70a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.501461:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526200/0x7f1093851e2da70a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.501474:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526200/0x7f1093851e2da70a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.503840:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527e00/0x7f1093851e2da711 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.503859:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527e00/0x7f1093851e2da711 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.503870:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527e00/0x7f1093851e2da711 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844812.503883:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788844812.516288:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da703 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516306:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da703 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516314:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da703 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516320:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.516325:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da703 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516333:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da703 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516698:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91eec7351300) 00010000:00010000:1.0:1788844812.516701:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.516723:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da703 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516729:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da703 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516746:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526200/0x7f1093851e2da70a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516752:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526200/0x7f1093851e2da70a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516757:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526200/0x7f1093851e2da70a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516761:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.516764:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526200/0x7f1093851e2da70a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516769:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526200/0x7f1093851e2da70a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516776:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91eee1796b00) 00010000:00010000:1.0:1788844812.516778:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.516780:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526200/0x7f1093851e2da70a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.516786:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526200/0x7f1093851e2da70a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.520096:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527400/0x7f1093851e2da6fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdc4 expref: 10 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.520138:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527e00/0x7f1093851e2da711 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdc4 expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.520147:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eee1796500) 00010000:00010000:1.0:1788844812.520150:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.520153:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527e00, rc 0) 00000100:00100000:1.0:1788844812.520226:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:14425:x1875739244876160:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 20966us (22394us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788844812.520235:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:2.0:1788844812.532346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844812.532696:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244876288 00000100:00100000:3.0:1788844812.532707:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244876288 00000100:00100000:3.0:1788844812.532806:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:3.0:1788844812.532818:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:14425:x1875739244876288:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788844812.532942:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:14425:x1875739244876288:12345-192.168.204.43@tcp:59:lhsmtool_posix.0 Request processed in 127us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844812.532951:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:2.0:1788844812.554041:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844812.554168:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244876416 00000100:00100000:0.0:1788844812.554186:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244876416 00000100:00100000:0.0:1788844812.554315:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:0.0:1788844812.554328:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:14431:x1875739244876416:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:0.0:1788844812.554420:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844812.554449:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da71f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fdcb expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554590:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526800/0x7f1093851e2da726 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554611:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526800/0x7f1093851e2da726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554626:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526800/0x7f1093851e2da726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554643:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da72d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554650:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da72d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554657:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da72d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554948:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526800/0x7f1093851e2da726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554957:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526800/0x7f1093851e2da726 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554975:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526800/0x7f1093851e2da726 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554981:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844812.554986:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526800/0x7f1093851e2da726 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.554994:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526800/0x7f1093851e2da726 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555009:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796800) 00010000:00010000:0.0:1788844812.555013:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844812.555017:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526800/0x7f1093851e2da726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555024:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526800/0x7f1093851e2da726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555037:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da72d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555044:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da72d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555051:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da72d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555056:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844812.555059:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da72d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555076:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da72d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555084:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91eee1796700) 00010000:00010000:0.0:1788844812.555087:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844812.555090:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da72d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555096:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da72d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555135:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da71f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdcb expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555146:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796800) 00010000:00010000:0.0:1788844812.555148:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788844812.555152:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da71f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdcb expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.555162:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526a00, rc 0) 00000100:00100000:0.0:1788844812.555246:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:14431:x1875739244876416:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 920us (1220us total) trans 0 rc 301/301 00000100:00100000:0.0:1788844812.555254:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:0.0:1788844812.561859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844812.562173:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244876544 00000100:00100000:3.0:1788844812.562187:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244876544 00000100:00100000:3.0:1788844812.562279:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1788844812.562292:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:14431:x1875739244876544:12345-192.168.204.43@tcp:700:lfs.0 00000100:00100000:3.0:1788844812.562402:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:14431:x1875739244876544:12345-192.168.204.43@tcp:700:lfs.0 Request processed in 112us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844812.562433:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:2.0:1788844812.568433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844812.568572:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244876800 00000100:00100000:1.0:1788844812.568586:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244876800 00000100:00100000:1.0:1788844812.568714:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:1.0:1788844812.568736:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:14431:x1875739244876800:12345-192.168.204.43@tcp:36:lfs.0 00010000:00010000:1.0:1788844812.568816:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788844812.568853:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0030600/0x7f1093851e2da662 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fd46 expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.568877:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796800) 00010000:00010000:1.0:1788844812.568882:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788844812.569263:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.569282:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fda8 expref: 5 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.569292:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.569345:0:14358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fda8 expref: 5 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.569362:0:14358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fda8 expref: 5 pid: 14358 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844812.569379:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff834380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267940096:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844812.569527:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec6bb2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788844812.574288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844812.574377:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff834380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267940096:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844812.574417:0:14358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844812.576974:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244876928 00000100:00100000:0.0:1788844812.576996:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244876928 00010000:00010000:0.0:1788844812.577065:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fda8 expref: 6 pid: 14358 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844812.577206:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:0.0:1788844812.577219:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:2355:x1875739244876928:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844812.577242:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844812.577251:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fda8 expref: 6 pid: 14358 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.577266:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fda8 expref: 6 pid: 14358 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.577296:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da69a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fda8 expref: 6 pid: 14358 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.577319:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796800) 00010000:00010000:0.0:1788844812.577325:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.577337:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.577346:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844812.577386:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844812.577474:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2355:x1875739244876928:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 259us (3202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844812.577482:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00010000:00010000:1.0:1788844812.577935:0:14358:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.577945:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.577974:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.577987:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.577995:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844812.580009:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788844812.581488:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.581584:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.581606:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.581614:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.581634:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.581645:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.581691:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eee1796800) 00010000:00010000:1.0:1788844812.581695:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.581711:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.581720:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da734 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788844812.581799:0:14358:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cd59644 reply state 000000000bd1d453 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844812.581825:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788844812.582122:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+10:14431:x1875739244876800:12345-192.168.204.43@tcp:36:lfs.0 Request processed in 13384us (13686us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788844812.582142:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00010000:00010000:3.0:1788844812.585336:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.585360:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.585370:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.585377:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844812.585384:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.585393:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.585420:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91eec7351700) 00010000:00010000:3.0:1788844812.585424:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844812.585430:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.585437:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da73b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844812.668452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844812.669576:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244877056 00000100:00100000:1.0:1788844812.669615:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244877056 00000100:00100000:1.0:1788844812.669704:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:1.0:1788844812.669717:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:14439:x1875739244877056:12345-192.168.204.43@tcp:101:lctl.0 00010000:00010000:1.0:1788844812.669750:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844812.669779:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da742 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fdd2 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.670051:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da749 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.670070:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da749 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.670084:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da749 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844812.670131:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788844812.670136:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844812.670186:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da749 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.670215:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da742 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdd2 expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.670240:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60c00/0x7f1093851e2da749 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdd2 expref: 10 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.670250:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351600) 00010000:00010000:1.0:1788844812.670253:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788844812.670258:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60c00, rc 0) 00000100:00100000:1.0:1788844812.670529:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+10:14439:x1875739244877056:12345-192.168.204.43@tcp:101:lctl.0 Request processed in 814us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844812.670592:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:2.0:1788844812.701051:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844812.701416:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244877184 00000100:00100000:3.0:1788844812.701431:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244877184 00000100:00100000:2.0:1788844812.701978:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:2.0:1788844812.702005:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:14440:x1875739244877184:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:2.0:1788844812.702036:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844812.702068:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fdd9 expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.702157:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c200/0x7f1093851e2da757 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.702194:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c200/0x7f1093851e2da757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.702210:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c200/0x7f1093851e2da757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844812.702260:0:16294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788844812.702264:0:16294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844812.702292:0:16294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c200/0x7f1093851e2da757 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.702321:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdd9 expref: 7 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.702343:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c200/0x7f1093851e2da757 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdd9 expref: 6 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.702353:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351600) 00010000:00010000:2.0:1788844812.702356:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788844812.702360:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ef0170c200, rc 0) 00000100:00100000:2.0:1788844812.702443:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:14440:x1875739244877184:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 453us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844812.702451:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1788844812.705141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844812.707417:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244877312 00000100:00100000:1.0:1788844812.707439:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244877312 00000100:00100000:1.0:1788844812.707653:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:1.0:1788844812.707666:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:14440:x1875739244877312:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844812.707698:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844812.707738:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da75e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fde0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.707835:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da765 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.707855:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.707882:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.707901:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da76c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.707908:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.707915:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708582:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da773 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708621:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708635:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844812.708685:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788844812.708690:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844812.708708:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708722:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da765 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708730:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da765 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708737:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da765 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708743:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.708747:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da765 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708755:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da765 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708767:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351600) 00010000:00010000:1.0:1788844812.708770:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.708773:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708791:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708810:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da76c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708816:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da76c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708822:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da76c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708828:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.708831:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da76c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708837:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da76c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708845:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91eec7351700) 00010000:00010000:1.0:1788844812.708848:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.708851:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da76c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708857:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da76c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708900:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da75e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fde0 expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708926:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da773 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fde0 expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.708936:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:1.0:1788844812.708938:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788844812.708941:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60000, rc 0) 00000100:00100000:1.0:1788844812.709025:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+7:14440:x1875739244877312:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1361us (3909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844812.709033:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:2.0:1788844812.712164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844812.712206:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244877568 00000100:00100000:3.0:1788844812.712220:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244877568 00000100:00100000:3.0:1788844812.712292:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:3.0:1788844812.712303:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+7:14440:x1875739244877568:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844812.712350:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844812.712382:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da77a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fde7 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844812.712513:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788844812.713214:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da77a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fde7 expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.713237:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351600) 00010000:00010000:3.0:1788844812.713241:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844812.713248:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da77a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fde7 expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.713265:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024c00, rc 0) 00000100:00100000:3.0:1788844812.713354:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+8:14440:x1875739244877568:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 1052us (1205us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788844812.713363:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:1.0:1788844812.716958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844812.717642:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244877824 00000100:00100000:2.0:1788844812.717661:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244877824 00000100:00100000:2.0:1788844812.717743:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 24 00000100:00100000:2.0:1788844812.717755:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+8:14440:x1875739244877824:12345-192.168.204.43@tcp:36:lfs.0 00010000:00010000:2.0:1788844812.717897:0:16294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844812.717935:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da773 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fde0 expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.717960:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eec7351400) 00010000:00010000:2.0:1788844812.717975:0:16294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788844812.718180:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.718199:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.718221:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788844812.718621:0:16294:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035e27272 reply state 000000008db59d6e transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844812.718631:0:16294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788844812.718641:0:16294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788844812.718764:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+9:14440:x1875739244877824:12345-192.168.204.43@tcp:36:lfs.0 Request processed in 1009us (1815us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788844812.718772:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 24 00010000:00010000:3.0:1788844812.721794:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.721823:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844812.721835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:3.0:1788844812.721838:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.721847:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170c400 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844812.721853:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.721888:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.721912:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eec8177000) 00010000:00010000:3.0:1788844812.721915:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788844812.721933:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.721941:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170c400/0x7f1093851e2da788 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844812.723980:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244878080 00000100:00100000:1.0:1788844812.723995:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244878080 00000100:00100000:1.0:1788844812.724102:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:1.0:1788844812.724113:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+8:14440:x1875739244878080:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844812.724378:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+9:14440:x1875739244878080:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 267us (2554us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788844812.724396:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:3.0:1788844812.730445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844812.731740:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244878336 00000100:00100000:1.0:1788844812.731756:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244878336 00000100:00100000:1.0:1788844812.731841:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 25 00000100:00100000:1.0:1788844812.731850:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+9:14440:x1875739244878336:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844812.731874:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844812.731894:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da78f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fdee expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.731982:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da796 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.731995:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732006:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732018:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da79d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732025:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da79d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732031:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da79d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844812.732140:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788844812.732227:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732234:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da796 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732241:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732247:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.732268:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732285:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da796 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732298:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351600) 00010000:00010000:1.0:1788844812.732301:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.732306:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732311:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732325:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da79d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732331:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da79d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732336:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da79d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732341:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.732344:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da79d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732348:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da79d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732354:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91eec7351700) 00010000:00010000:1.0:1788844812.732356:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.732358:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da79d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732372:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da79d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732410:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da78f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdee expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732421:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351600) 00010000:00010000:1.0:1788844812.732423:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788844812.732427:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da78f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdee expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.732437:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61a00, rc 0) 00000100:00100000:1.0:1788844812.732521:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+10:14440:x1875739244878336:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 671us (2092us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788844812.732528:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 25 00010000:00010000:2.0:1788844812.737404:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788844812.738455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844812.738571:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244878464 00000100:00100000:3.0:1788844812.738581:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244878464 00000100:00100000:3.0:1788844812.738646:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:3.0:1788844812.738657:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+10:14440:x1875739244878464:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844812.738680:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844812.738703:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da7ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fdf5 expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.738989:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.739005:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.739018:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844812.739047:0:16294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788844812.739066:0:16294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788844812.739090:0:16294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.739121:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da7ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdf5 expref: 12 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.739143:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdf5 expref: 11 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.739151:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eed03a8100) 00010000:00010000:3.0:1788844812.739154:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788844812.739158:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024000, rc 0) 00000100:00100000:3.0:1788844812.739225:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+11:14440:x1875739244878464:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 569us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844812.739232:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 26 00000100:00100000:3.0:1788844812.746798:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844812.746935:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244878592 00000100:00100000:0.0:1788844812.746945:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244878592 00000100:00100000:0.0:1788844812.747004:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:0.0:1788844812.747014:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+11:14440:x1875739244878592:12345-192.168.204.43@tcp:37:lfs.0 00000100:00100000:0.0:1788844812.768290:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+11:14440:x1875739244878592:12345-192.168.204.43@tcp:37:lfs.0 Request processed in 21266us (21491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844812.768305:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:2.0:1788844812.780136:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844812.780252:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244878848 00000100:00100000:1.0:1788844812.780262:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244878848 00000100:00100000:1.0:1788844812.780352:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:1.0:1788844812.780362:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec56e3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+11:14440:x1875739244878848:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844812.780897:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec56e3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+12:14440:x1875739244878848:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 523us (760us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788844812.780906:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:0.0:1788844812.859679:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844812.860592:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244878976 00000100:00100000:1.0:1788844812.860605:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244878976 00000100:00100000:1.0:1788844812.860670:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:1.0:1788844812.860681:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+10:14446:x1875739244878976:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1788844812.860715:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844812.860737:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fdfc expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.860802:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.860816:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.860827:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.860841:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.860848:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.860855:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.860964:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da7ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.860973:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da7ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.860980:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da7ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844812.861017:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788844812.861026:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844812.861067:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da7ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861080:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861087:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861094:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861100:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.861114:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861123:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861135:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351600) 00010000:00010000:1.0:1788844812.861138:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.861142:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861148:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861162:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861169:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861185:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861191:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61e00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.861193:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861200:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861208:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91eec7351700) 00010000:00010000:1.0:1788844812.861221:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.861224:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861230:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861261:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdfc expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861273:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61600/0x7f1093851e2da7ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdfc expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.861280:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eed03a8100) 00010000:00010000:1.0:1788844812.861282:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788844812.861285:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61600, rc 0) 00000100:00100000:1.0:1788844812.861351:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+11:14446:x1875739244878976:12345-192.168.204.43@tcp:101:bash.0 Request processed in 671us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844812.861367:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 27 00000100:00100000:0.0:1788844812.866852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844812.867046:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244879232 00000100:00100000:2.0:1788844812.867058:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244879232 00000100:00100000:2.0:1788844812.867124:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 28 00000100:00100000:2.0:1788844812.867145:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+11:14446:x1875739244879232:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:2.0:1788844812.867164:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788844812.867182:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170de00/0x7f1093851e2da7d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe03 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.867414:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.867673:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdf5 expref: 11 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.867687:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.867723:0:14358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdf5 expref: 11 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.867737:0:14358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdf5 expref: 11 pid: 16294 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844812.867751:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e20700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267940224:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844812.867839:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed2c6a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844812.874827:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e20700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267940224:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844812.874875:0:14358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844812.881762:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844812.882383:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244879360 00000100:00100000:2.0:1788844812.882395:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244879360 00010000:00010000:2.0:1788844812.882450:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdf5 expref: 12 pid: 16294 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844812.882492:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:2.0:1788844812.882516:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb393800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+12:2355:x1875739244879360:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844812.882746:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844812.882755:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdf5 expref: 12 pid: 16294 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.882770:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdf5 expref: 12 pid: 16294 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.882792:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024000/0x7f1093851e2da7b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fdf5 expref: 12 pid: 16294 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.882810:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eed03a8100) 00010000:00010000:2.0:1788844812.882815:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.882824:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.882831:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844812.882953:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788844812.883273:0:14358:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.883281:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.883306:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.883315:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.883323:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884145:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884157:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884165:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844812.884176:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788844812.884205:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884220:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884225:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884232:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844812.884236:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884244:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884254:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eed03a8100) 00010000:00010000:1.0:1788844812.884257:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788844812.884261:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884267:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d200/0x7f1093851e2da7dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788844812.884279:0:14358:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002beaf05c reply state 0000000056292311 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844812.884288:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788844812.884326:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170de00/0x7f1093851e2da7d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe03 expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884341:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe03 expref: 13 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.884359:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:1.0:1788844812.884362:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788844812.884365:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61e00, rc 0) 00000100:00100000:2.0:1788844812.884632:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb393800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+11:2355:x1875739244879360:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 2130us (2880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844812.884644:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:1.0:1788844812.885481:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:14446:x1875739244879232:12345-192.168.204.43@tcp:101:bash.0 Request processed in 18331us (18633us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788844812.885489:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 28 00010000:00010000:3.0:1788844812.894811:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.894831:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.894839:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.894845:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844812.894850:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.894890:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.894908:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91eec7351700) 00010000:00010000:3.0:1788844812.894911:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844812.894916:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844812.894923:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da7e3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844812.929438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844812.929580:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244879488 00000100:00100000:1.0:1788844812.929589:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244879488 00000100:00100000:1.0:1788844812.929639:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:1.0:1788844812.929648:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+13:14446:x1875739244879488:12345-192.168.204.43@tcp:101:bash.0 00010000:00010000:1.0:1788844812.929670:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844812.929691:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe0a expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.929766:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.929781:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.929791:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844812.929830:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788844812.929834:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844812.929850:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.929897:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.929920:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da7f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe0a expref: 15 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.929938:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe0a expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844812.929947:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:1.0:1788844812.929950:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844812.929953:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60a00, rc 0) 00000100:00100000:1.0:1788844812.930025:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:14446:x1875739244879488:12345-192.168.204.43@tcp:101:bash.0 Request processed in 377us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844812.930031:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 29 00000100:00100000:2.0:1788844812.944423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844812.944576:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244879744 00000100:00100000:0.0:1788844812.944588:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244879744 00000100:00100000:0.0:1788844812.944641:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:0.0:1788844812.944651:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:14446:x1875739244879744:12345-192.168.204.43@tcp:35:bash.0 00000100:00100000:0.0:1788844812.945054:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:14446:x1875739244879744:12345-192.168.204.43@tcp:35:bash.0 Request processed in 403us (640us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788844812.945063:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000040:00080000:3.0:1788844813.114404:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788844813.144721:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844813.144978:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244880000 00000100:00100000:3.0:1788844813.144993:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244880000 00000100:00100000:3.0:1788844813.145199:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:3.0:1788844813.145215:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:14456:x1875739244880000:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:3.0:1788844813.145251:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788844813.145291:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe11 expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788844813.145421:0:16294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788844813.145644:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da806 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe11 expref: 17 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844813.145663:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91eec7351600) 00010000:00010000:3.0:1788844813.145666:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788844813.145672:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe11 expref: 17 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844813.145712:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec0024c00, rc 0) 00000100:00100000:3.0:1788844813.145804:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14456:x1875739244880000:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 595us (1106us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788844813.145813:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00080000:1.0:1788844813.148173:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788844813.154583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844813.158630:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244880256 00000100:00100000:0.0:1788844813.158659:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244880256 00000100:00100000:0.0:1788844813.158759:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:0.0:1788844813.158775:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14456:x1875739244880256:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:0.0:1788844813.160519:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+17:14456:x1875739244880256:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 1737us (5984us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788844813.160534:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:0.0:1788844813.258847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844813.259521:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244880512 00000100:00100000:1.0:1788844813.259632:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244880512 00000100:00100000:1.0:1788844813.259718:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:1.0:1788844813.259730:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+17:14459:x1875739244880512:12345-192.168.204.43@tcp:101:lfs.0 00010000:00010000:1.0:1788844813.259780:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844813.259806:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da814 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe18 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.259943:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da81b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.259961:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da81b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.259985:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da81b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844813.259998:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788844813.260159:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da814 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe18 expref: 20 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.260183:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da81b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe18 expref: 19 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.260193:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:1.0:1788844813.260196:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844813.260200:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61a00, rc 0) 00000100:00100000:1.0:1788844813.260288:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+19:14459:x1875739244880512:12345-192.168.204.43@tcp:101:lfs.0 Request processed in 559us (1458us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788844813.260295:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:2.0:1788844813.268690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844813.268740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844813.268809:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244880640 00000100:00100000:1.0:1788844813.268828:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244880640 00000100:00100000:3.0:1788844813.268843:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244880768 00000100:00100000:3.0:1788844813.268857:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244880768 00000100:00100000:1.0:1788844813.268937:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 32 00000100:00100000:3.0:1788844813.268962:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:1.0:1788844813.268963:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+20:14459:x1875739244880640:12345-192.168.204.43@tcp:54:lfs.0 00010000:00010000:1.0:1788844813.269066:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da829 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.269090:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da829 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.269106:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da829 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.269168:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da829 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.269178:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da829 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.269186:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da829 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.269194:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844813.269199:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da829 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.269209:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da829 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.269226:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:1.0:1788844813.269229:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788844813.269234:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da829 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.269241:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da829 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844813.269311:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+20:2354:x1875739244880768:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844813.269335:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788844813.269350:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+20:14459:x1875739244880640:12345-192.168.204.43@tcp:54:lfs.0 Request processed in 398us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844813.269362:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 32 00010000:00010000:3.0:1788844813.269373:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61a00/0x7f1093851e2da81b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe18 expref: 20 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844813.269398:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:3.0:1788844813.269404:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844813.269461:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+18:2354:x1875739244880768:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 486us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844813.270086:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1788844813.285717:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844813.286344:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244881024 00000100:00100000:1.0:1788844813.286363:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244881024 00000100:00100000:1.0:1788844813.286462:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:1.0:1788844813.286503:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+18:14459:x1875739244881024:12345-192.168.204.43@tcp:35:lfs.0 00000100:00100000:1.0:1788844813.287509:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+19:14459:x1875739244881024:12345-192.168.204.43@tcp:35:lfs.0 Request processed in 1001us (1783us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788844813.287523:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000001:00080000:3.0:1788844813.700655:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:3.0:1788844813.700681:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:3.0:1788844813.700693:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1788844813.753837:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844813.759828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844813.759946:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244881280 00000100:00100000:1.0:1788844813.759960:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244881280 00000100:00100000:1.0:1788844813.760053:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:1.0:1788844813.760066:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+11:14490:x1875739244881280:12345-192.168.204.43@tcp:101:cat.0 00010000:00010000:1.0:1788844813.760100:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844813.760130:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da830 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe1f expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.760279:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da837 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.760297:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.760311:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da837 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844813.760323:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788844813.760664:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da830 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe1f expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.760689:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da837 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe1f expref: 13 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.760722:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:1.0:1788844813.760725:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788844813.760729:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60000, rc 0) 00000100:00100000:1.0:1788844813.760813:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+13:14490:x1875739244881280:12345-192.168.204.43@tcp:101:cat.0 Request processed in 750us (1002us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788844813.760821:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 33 00000100:00100000:2.0:1788844813.766817:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844813.767084:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244881664 00000100:00100000:0.0:1788844813.767098:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244881664 00000100:00100000:0.0:1788844813.767475:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:0.0:1788844813.767498:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+13:14490:x1875739244881664:12345-192.168.204.43@tcp:35:cat.0 00000100:00100000:0.0:1788844813.768023:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:14490:x1875739244881664:12345-192.168.204.43@tcp:35:cat.0 Request processed in 527us (1218us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788844813.768032:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 8 00000100:00100000:3.0:1788844813.768398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844813.768521:0:16477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244881408 00000100:00100000:2.0:1788844813.768532:0:16477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244881408 00000100:00100000:2.0:1788844813.768735:0:16477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:2.0:1788844813.768747:0:16477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:2357:x1875739244881408:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844813.768765:0:16477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844813.768794:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60000/0x7f1093851e2da837 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe1f expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.768818:0:16477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:2.0:1788844813.768824:0:16477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844813.768884:0:16477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+13:2357:x1875739244881408:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 138us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844813.768892:0:16477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:2.0:1788844813.861947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844813.862115:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244881920 00000100:00100000:1.0:1788844813.862127:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244881920 00000100:00100000:1.0:1788844813.862193:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:1.0:1788844813.862203:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+13:14496:x1875739244881920:12345-192.168.204.43@tcp:101:dd.0 00010000:00010000:1.0:1788844813.862226:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844813.862247:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da845 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe26 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.862359:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.862376:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe03 expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.862385:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe0a expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.862394:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.862430:0:14358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe0a expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.862462:0:14358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe0a expref: 14 pid: 14359 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844813.862492:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267940352:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844813.862642:0:14358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe03 expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.862653:0:14358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe03 expref: 14 pid: 14358 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844813.862662:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267940480:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844813.862688:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec4fb3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788844813.867205:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267940352:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844813.868028:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844813.868792:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244882048 00000100:00100000:0.0:1788844813.868812:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244882048 00010000:00010000:0.0:1788844813.868878:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe0a expref: 15 pid: 14359 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844813.869463:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1788844813.869491:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc2e99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:2355:x1875739244882048:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844813.869523:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844813.869532:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe0a expref: 15 pid: 14359 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.869589:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe0a expref: 15 pid: 14359 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.869619:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60a00/0x7f1093851e2da7ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe0a expref: 15 pid: 14359 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.869643:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:0.0:1788844813.869651:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.869682:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.869690:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844813.869784:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc2e99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:2355:x1875739244882048:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 308us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844813.869793:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:3.0:1788844813.884049:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844813.884406:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff836300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267940480:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844813.884438:0:14358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844813.884567:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244882176 00000100:00100000:2.0:1788844813.884575:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244882176 00010000:00010000:2.0:1788844813.884611:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe03 expref: 14 pid: 14358 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844813.884661:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 12 00000100:00100000:2.0:1788844813.884671:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:2355:x1875739244882176:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844813.884687:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844813.884695:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe03 expref: 14 pid: 14358 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.884707:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe03 expref: 14 pid: 14358 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.884737:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da7ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe03 expref: 14 pid: 14358 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.884755:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:2.0:1788844813.884760:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.884768:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.884776:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.884806:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844813.884868:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+13:2355:x1875739244882176:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 198us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844813.884877:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 12 00010000:00010000:1.0:1788844813.885064:0:14358:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.885072:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844813.885092:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788844813.885257:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da845 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe26 expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.885287:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d60600/0x7f1093851e2da84c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe26 expref: 13 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844813.885297:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:1.0:1788844813.885301:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788844813.885303:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60600, rc 0) 00000100:00100000:1.0:1788844813.885329:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+13:14496:x1875739244881920:12345-192.168.204.43@tcp:101:dd.0 Request processed in 23129us (23396us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788844813.885336:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 34 00000100:00100000:1.0:1788844813.893533:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844813.893679:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244882432 00000100:00100000:0.0:1788844813.893689:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244882432 00000100:00100000:0.0:1788844813.893752:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 35 00000100:00100000:0.0:1788844813.893763:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+13:14496:x1875739244882432:12345-192.168.204.43@tcp:36:dd.0 00010000:00010000:0.0:1788844813.894040:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.894057:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.894067:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788844813.894121:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788844813.894156:0:14359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c21f84f reply state 000000003ff01de1 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844813.894165:0:14359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788844813.894260:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14496:x1875739244882432:12345-192.168.204.43@tcp:36:dd.0 Request processed in 498us (739us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788844813.894268:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 35 00000020:00080000:0.0:1788844813.894272:0:14359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788844813.900173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00010000:00010000:2.0:1788844813.900293:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.900318:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.900326:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.900332:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844813.900337:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.900372:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.900391:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:2.0:1788844813.900394:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844813.900400:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844813.900406:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da85a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844813.900742:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244882560 00000100:00100000:0.0:1788844813.900754:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244882560 00000100:00100000:0.0:1788844813.900821:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:0.0:1788844813.900834:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:14496:x1875739244882560:12345-192.168.204.43@tcp:101:dd.0 00010000:00010000:0.0:1788844813.900863:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844813.900881:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da861 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe2d expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.900944:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da861 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe2d expref: 16 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.900957:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da861 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe2d expref: 16 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.900976:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:0.0:1788844813.900980:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788844813.900982:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527a00, rc 0) 00000100:00100000:0.0:1788844813.901047:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14496:x1875739244882560:12345-192.168.204.43@tcp:101:dd.0 Request processed in 216us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844813.901054:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 36 00000100:00100000:0.0:1788844813.939495:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844813.939703:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244882816 00000100:00100000:3.0:1788844813.939714:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244882816 00000100:00100000:3.0:1788844813.939797:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:3.0:1788844813.939821:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb393800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14496:x1875739244882816:12345-192.168.204.43@tcp:103:dd.0 00010000:00010000:3.0:1788844813.939839:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844813.939866:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da861 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe2d expref: 16 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844813.939886:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:3.0:1788844813.939891:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844813.939950:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb393800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:14496:x1875739244882816:12345-192.168.204.43@tcp:103:dd.0 Request processed in 133us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844813.939959:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:3.0:1788844813.944775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844813.948467:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244882944 00000100:00100000:0.0:1788844813.948498:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244882944 00000100:00100000:0.0:1788844813.948616:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:0.0:1788844813.948627:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:14496:x1875739244882944:12345-192.168.204.43@tcp:58:dd.0 00010000:00010000:0.0:1788844813.948745:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.948782:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.948794:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788844813.950074:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788844813.950221:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788844813.950287:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788844813.950414:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:14496:x1875739244882944:12345-192.168.204.43@tcp:58:dd.0 Request processed in 1784us (5648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844813.950425:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 37 00000100:00100000:2.0:1788844813.953908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844813.954248:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244883072 00000100:00100000:0.0:1788844813.954260:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244883072 00000100:00100000:0.0:1788844813.954317:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:0.0:1788844813.954341:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:14496:x1875739244883072:12345-192.168.204.43@tcp:101:dd.0 00010000:00010000:0.0:1788844813.954361:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844813.954383:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2da86f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe34 expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.954449:0:16294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.954459:0:16294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2da86f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe34 expref: 16 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.954493:0:16294:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.954528:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2da86f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe34 expref: 16 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.954671:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:0.0:1788844813.954674:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788844813.954679:0:16294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2da86f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe34 expref: 16 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844813.954687:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526000, rc 0) 00000100:00100000:0.0:1788844813.954754:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14496:x1875739244883072:12345-192.168.204.43@tcp:101:dd.0 Request processed in 415us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844813.954760:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 38 00000100:00100000:1.0:1788844814.073868:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267940992:0@lo:400:kworker.0 00000100:00100000:1.0:1788844814.073942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844814.074017:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788844814.074024:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267940864:0@lo:400:kworker.0 00000100:00100000:1.0:1788844814.074066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844814.074106:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267940864 00000100:00100000:1.0:1788844814.074114:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267940864 00000100:00100000:1.0:1788844814.074172:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788844814.074182:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267940864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844814.074236:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267940864:12345-0@lo:400:kworker.0 Request processed in 55us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844814.074243:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788844814.074265:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788844814.074296:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267940864:0@lo:400:kworker.0 00000100:00100000:2.0:1788844814.074595:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267940736:0@lo:400:kworker.0 00000100:00100000:2.0:1788844814.074625:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844814.074652:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267941248:0@lo:400:kworker.0 00000100:00100000:2.0:1788844814.074678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844814.074698:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788844814.074704:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267940608:0@lo:400:kworker.0 00000100:00100000:2.0:1788844814.074729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844814.074752:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267941120:0@lo:400:kworker.0 00000100:00100000:2.0:1788844814.074774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844814.074800:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267940608 00000100:00100000:2.0:1788844814.074805:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267940608 00000100:00100000:2.0:1788844814.074835:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788844814.074842:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267940608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788844814.074878:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267940608:12345-0@lo:400:kworker.0 Request processed in 36us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844814.074904:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788844814.074941:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267940608:0@lo:400:kworker.0 00000100:00100000:0.0:1788844814.075703:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267940992 00000100:00100000:0.0:1788844814.075712:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267940992 00000100:00100000:0.0:1788844814.075749:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267941248 00000100:00100000:0.0:1788844814.075752:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267941248 00000100:00100000:0.0:1788844814.075771:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267941120 00000100:00100000:0.0:1788844814.075775:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267941120 00000100:00100000:0.0:1788844814.075791:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788844814.075799:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267940992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844814.075856:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875739267940992:12345-0@lo:400:kworker.0 Request processed in 58us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.075863:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788844814.075877:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788844814.075883:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267941248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844814.075914:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875739267941248:12345-0@lo:400:kworker.0 Request processed in 32us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.075930:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788844814.075943:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788844814.075948:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267941120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788844814.076157:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267941120:12345-0@lo:400:kworker.0 Request processed in 208us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.076164:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788844814.076183:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788844814.076211:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267941120:0@lo:400:kworker.0 00000100:00100000:0.0:1788844814.076221:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875739267941248:0@lo:400:kworker.0 00000100:00100000:0.0:1788844814.076250:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875739267940992:0@lo:400:kworker.0 00000100:00100000:1.0:1788844814.076333:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267940736 00000100:00100000:1.0:1788844814.076344:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267940736 00000100:00100000:1.0:1788844814.076384:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788844814.076391:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc24fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267940736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844814.076425:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc24fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875739267940736:12345-0@lo:400:kworker.0 Request processed in 36us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844814.076430:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788844814.077412:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267941376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844814.077461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844814.077519:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267941376 00000100:00100000:3.0:1788844814.077524:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267941376 00000100:00100000:3.0:1788844814.077626:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788844814.077634:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267941376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844814.077662:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844814.077701:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267941376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844814.077708:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788844814.077745:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267941376:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788844814.079371:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788844814.079424:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875739267940736:0@lo:400:kworker.0 00000040:00080000:3.0:1788844814.137823:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788844814.137833:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788844814.137888:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788844814.137895:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788844814.138257:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff31ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14390:1875739267941504:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788844814.138348:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed82173c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788844814.148292:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff31ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14390:1875739267941504:192.168.204.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788844814.148795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844814.149954:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244883200 00000100:00100000:3.0:1788844814.149981:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244883200 00000100:00100000:3.0:1788844814.150037:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1788844814.150046:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14497:x1875739244883200:12345-192.168.204.43@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788844814.150143:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14497:x1875739244883200:12345-192.168.204.43@tcp:900:lhsmtool_posix.0 Request processed in 98us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844814.150156:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:2.0:1788844814.159377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.160120:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244883328 00000100:00100000:0.0:1788844814.160143:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244883328 00000100:00100000:0.0:1788844814.160213:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:0.0:1788844814.160224:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14497:x1875739244883328:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788844814.160258:0:16294:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788844814.160361:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14497:x1875739244883328:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 139us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.160368:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 39 00000100:00100000:0.0:1788844814.177336:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844814.177451:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244883456 00000100:00100000:2.0:1788844814.177462:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244883456 00000100:00100000:2.0:1788844814.177587:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:2.0:1788844814.177597:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14497:x1875739244883456:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788844814.177667:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d400/0x7f1093851e2da876 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177684:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d400/0x7f1093851e2da876 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177695:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d400/0x7f1093851e2da876 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177741:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da87d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177749:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da87d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177756:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da87d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177781:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177788:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177809:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788844814.177852:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788844814.177855:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788844814.177871:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177883:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d400/0x7f1093851e2da876 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177888:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d400/0x7f1093851e2da876 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177895:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d400/0x7f1093851e2da876 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177900:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d400 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844814.177905:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d400/0x7f1093851e2da876 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177913:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d400/0x7f1093851e2da876 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177925:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eee1796500) 00010000:00010000:2.0:1788844814.177928:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844814.177932:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d400/0x7f1093851e2da876 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177938:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d400/0x7f1093851e2da876 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177976:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da87d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177982:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da87d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177987:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da87d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.177992:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844814.177996:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da87d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.178001:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da87d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.178008:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff91eec8177500) 00010000:00010000:2.0:1788844814.178011:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844814.178014:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da87d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.178019:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da87d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.178035:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.178041:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.178046:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.178059:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170ca00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844814.178062:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.178068:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.178076:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:2.0:1788844814.178078:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844814.178080:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.178086:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170ca00/0x7f1093851e2da884 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844814.178168:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14497:x1875739244883456:12345-192.168.204.43@tcp:34:lhsmtool_posix.0 Request processed in 572us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844814.178176:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 40 00000100:00100000:3.0:1788844814.193256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.193731:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244883712 00000100:00100000:0.0:1788844814.193745:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244883712 00000100:00100000:0.0:1788844814.193814:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:0.0:1788844814.193836:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:14497:x1875739244883712:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788844814.193859:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844814.193880:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da88b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe3b expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194226:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da892 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194242:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da892 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194253:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da892 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788844814.194264:0:16294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788844814.194363:0:16294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da892 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194371:0:16294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da892 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194377:0:16294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da892 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194383:0:16294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527800 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:0.0:1788844814.194388:0:16294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da892 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194395:0:16294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da892 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194407:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:0.0:1788844814.194417:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788844814.194422:0:16294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da892 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194428:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da892 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194488:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da88b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe3b expref: 18 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194500:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91eee1796500) 00010000:00010000:0.0:1788844814.194502:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788844814.194506:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da88b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe3b expref: 18 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.194515:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527a00, rc 0) 00000100:00100000:0.0:1788844814.195090:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+17:14497:x1875739244883712:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1252us (1840us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788844814.195100:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 41 00000100:00100000:0.0:1788844814.203727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844814.203840:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244883840 00000100:00100000:2.0:1788844814.203853:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244883840 00000100:00100000:2.0:1788844814.203975:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:2.0:1788844814.203986:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+17:14497:x1875739244883840:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788844814.204027:0:14359:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788844814.205139:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+17:14497:x1875739244883840:12345-192.168.204.43@tcp:53:lhsmtool_posix.0 Request processed in 1138us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844814.205151:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 42 00000100:00100000:1.0:1788844814.213856:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.214032:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244884096 00000100:00100000:0.0:1788844814.214142:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244884096 00000100:00100000:0.0:1788844814.214317:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:0.0:1788844814.214329:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+17:14497:x1875739244884096:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788844814.214349:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844814.214379:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da8a0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe42 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788844814.215249:0:14358:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788844814.215264:0:14358:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788844814.215316:0:14358:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788844814.215642:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da8a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.215657:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.215667:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.215729:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da8a0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe42 expref: 20 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.215747:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da8a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe42 expref: 19 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.215755:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796700) 00010000:00010000:0.0:1788844814.215758:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788844814.215762:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5527800, rc 0) 00000100:00100000:0.0:1788844814.215835:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+19:14497:x1875739244884096:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 1508us (1990us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788844814.215842:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 43 00000100:00100000:1.0:1788844814.226768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844814.226927:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244884352 00000100:00100000:3.0:1788844814.226938:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244884352 00000100:00100000:3.0:1788844814.227013:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:3.0:1788844814.227023:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+19:14497:x1875739244884352:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788844814.227087:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844814.227117:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527800/0x7f1093851e2da8a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe42 expref: 19 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227239:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796700) 00010000:00010000:3.0:1788844814.227251:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844814.227289:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da8b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227302:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da8b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227311:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da8b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227370:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025a00/0x7f1093851e2da8bc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x91015c21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227376:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025a00/0x7f1093851e2da8bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91015c21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227382:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025a00/0x7f1093851e2da8bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91015c21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227669:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da8b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227676:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da8b5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227682:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da8b5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227688:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0024c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844814.227692:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da8b5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227700:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da8b5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227719:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91eed03a8100) 00010000:00010000:3.0:1788844814.227722:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844814.227726:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da8b5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227732:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0024c00/0x7f1093851e2da8b5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227740:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025a00/0x7f1093851e2da8bc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91015c21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227746:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025a00/0x7f1093851e2da8bc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91015c21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227751:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025a00/0x7f1093851e2da8bc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91015c21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227755:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844814.227758:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025a00/0x7f1093851e2da8bc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91015c21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227763:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025a00/0x7f1093851e2da8bc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x91015c21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227770:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x91015c21 (ffff91eed03a8500) 00010000:00010000:3.0:1788844814.227773:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844814.227775:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025a00/0x7f1093851e2da8bc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x91015c21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.227781:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025a00/0x7f1093851e2da8bc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x91015c21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844814.227924:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+18:14497:x1875739244884352:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 901us (1164us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788844814.227932:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 44 00000100:00100000:2.0:1788844814.238493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.240065:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244884480 00000100:00100000:0.0:1788844814.240080:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244884480 00000100:00100000:0.0:1788844814.240159:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:0.0:1788844814.240169:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+18:14497:x1875739244884480:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788844814.240189:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844814.240211:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da8c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe49 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.240256:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2da8ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.240269:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2da8ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.240279:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2da8ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.240364:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527a00/0x7f1093851e2da8c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe49 expref: 20 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.240382:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526e00/0x7f1093851e2da8ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe49 expref: 19 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.240390:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:0.0:1788844814.240393:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788844814.240396:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526e00, rc 0) 00000100:00100000:0.0:1788844814.240463:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+19:14497:x1875739244884480:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 296us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.240480:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 45 00000100:00100000:1.0:1788844814.250952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844814.251120:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244884736 00000100:00100000:2.0:1788844814.251157:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244884736 00000100:00100000:2.0:1788844814.251214:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 46 00000100:00100000:2.0:1788844814.251224:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+19:14497:x1875739244884736:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788844814.251310:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.251328:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.251338:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788844814.252051:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788844814.252064:0:14359:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 528530527097ns, next at 529530524588ns, rc = 0 00000004:00010000:2.0:1788844814.252164:0:14359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a13b1a5e reply state 00000000b692cf40 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844814.252174:0:14359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788844814.252266:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+21:14497:x1875739244884736:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 1041us (1325us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788844814.252273:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 46 00010000:00010000:2.0:1788844814.255588:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.255606:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.255614:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.255620:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844814.255639:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.255648:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.255665:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:2.0:1788844814.255668:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788844814.255673:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.255679:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da8d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844814.255994:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.256238:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244884864 00000100:00100000:0.0:1788844814.256250:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244884864 00000100:00100000:0.0:1788844814.256309:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:0.0:1788844814.256320:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+20:14497:x1875739244884864:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788844814.256346:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788844814.256363:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da8d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe50 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.256435:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da8d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe50 expref: 21 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.256449:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da8d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe50 expref: 21 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.256467:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:0.0:1788844814.256480:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788844814.256483:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eec5526600, rc 0) 00000100:00100000:0.0:1788844814.256749:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+21:14497:x1875739244884864:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 429us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.256756:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 47 00000100:00100000:3.0:1788844814.263374:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844814.263487:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244884992 00000100:00100000:1.0:1788844814.263497:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244884992 00000100:00100000:1.0:1788844814.263607:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:1.0:1788844814.263618:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2356:x1875739244884992:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788844814.263985:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2356:x1875739244884992:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 367us (621us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788844814.263993:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00080000:0.0:1788844814.264077:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788844814.266584:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844814.266831:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244885248 00000100:00100000:1.0:1788844814.266842:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244885248 00000100:00100000:1.0:1788844814.266935:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:1.0:1788844814.266946:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+21:14497:x1875739244885248:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788844814.267686:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+22:14497:x1875739244885248:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 737us (1107us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788844814.267696:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 9 00000100:00100000:3.0:1788844814.272848:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.272964:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244885504 00000100:00100000:0.0:1788844814.272982:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244885504 00000100:00100000:0.0:1788844814.273042:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:0.0:1788844814.273052:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+22:14497:x1875739244885504:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788844814.273209:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+22:14497:x1875739244885504:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 157us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.273218:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 48 00000100:00100000:3.0:1788844814.279785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844814.279962:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244885632 00000100:00100000:1.0:1788844814.279991:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244885632 00000100:00100000:1.0:1788844814.280056:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:1.0:1788844814.280067:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+22:14497:x1875739244885632:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788844814.280088:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844814.280111:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da8df lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe57 expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.280185:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da8e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.280200:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.280212:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788844814.280246:0:16294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788844814.280266:0:16294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.280292:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61200/0x7f1093851e2da8df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe57 expref: 24 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.280311:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe57 expref: 23 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.280321:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:1.0:1788844814.280324:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788844814.280327:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61e00, rc 0) 00000100:00100000:1.0:1788844814.280389:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+23:14497:x1875739244885632:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 324us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844814.280403:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 49 00000100:00100000:3.0:1788844814.283981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844814.284192:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244885760 00000100:00100000:1.0:1788844814.284204:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244885760 00000100:00100000:1.0:1788844814.284315:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:1.0:1788844814.284326:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+6:2354:x1875739244885760:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788844814.284344:0:15043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844814.284364:0:15043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9d34939/0x7f1093851e2da8ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe5e expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788844814.284391:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9b0d, blocks: 0x1 00010000:00010000:1.0:1788844814.284411:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788844814.284416:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844814.284425:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d34939/0x7f1093851e2da8ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe5e expref: 7 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.284444:0:15043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b9d34939/0x7f1093851e2da8ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe5e expref: 7 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.284458:0:15043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d60000, rc 0) 00000100:00100000:1.0:1788844814.284531:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:2354:x1875739244885760:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 206us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844814.284571:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:1.0:1788844814.299494:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.299665:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244886016 00000100:00100000:0.0:1788844814.299677:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244886016 00000100:00100000:0.0:1788844814.299742:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:0.0:1788844814.299752:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+23:14497:x1875739244886016:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788844814.299856:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+23:14497:x1875739244886016:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 105us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.299876:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 50 00000100:00100000:3.0:1788844814.302661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844814.304858:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244886144 00000100:00100000:1.0:1788844814.304874:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244886144 00000100:00100000:1.0:1788844814.304949:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:1.0:1788844814.304957:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+23:14497:x1875739244886144:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788844814.381086:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1788844814.381114:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1788844814.381126:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788844814.381256:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267941632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788844814.381323:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844814.381629:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:14497:x1875739244886144:12345-192.168.204.43@tcp:44:lhsmtool_posix.0 Request processed in 76669us (78975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844814.381640:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 51 00000100:00100000:1.0:1788844814.381760:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267941632 00000100:00100000:1.0:1788844814.381767:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267941632 00000100:00100000:1.0:1788844814.381810:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788844814.381818:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267941632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788844814.381963:0:16295:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788844814.381967:0:16295:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788844814.381969:0:16295:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788844814.381971:0:16295:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788844813 -> 1788844813 00002000:00010000:1.0:1788844814.381974:0:16295:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788844814.382025:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875739267941632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (702us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788844814.382031:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788844814.382216:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91eefb390700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788844814.382222:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eefb390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267941632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788844814.385382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.385486:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244886272 00000100:00100000:0.0:1788844814.385496:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244886272 00000100:00100000:0.0:1788844814.385585:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:0.0:1788844814.385595:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:2355:x1875739244886272:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788844814.385695:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:2355:x1875739244886272:12345-192.168.204.43@tcp:16:lhsmtool_posix.0 Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.385703:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 16 00000100:00100000:0.0:1788844814.389432:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844814.389531:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244886528 00000100:00100000:3.0:1788844814.389718:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244886528 00000100:00100000:3.0:1788844814.389814:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:3.0:1788844814.389824:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:14497:x1875739244886528:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788844814.389884:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844814.389910:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eed0d61e00/0x7f1093851e2da8e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe57 expref: 14 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.389927:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:3.0:1788844814.389931:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788844814.389968:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.389995:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.390005:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788844814.390195:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007425a465 reply state 00000000c30dffd0 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844814.390204:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788844814.390282:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:14497:x1875739244886528:12345-192.168.204.43@tcp:36:lhsmtool_posix.0 Request processed in 459us (860us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788844814.390289:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 52 00000100:00100000:3.0:1788844814.395424:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:1.0:1788844814.398594:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244886656 00000100:00100000:1.0:1788844814.398610:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244886656 00000100:00100000:1.0:1788844814.398673:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:1.0:1788844814.398683:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:14497:x1875739244886656:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788844814.398698:0:16295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788844814.398715:0:16295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x359a22b62793fe65 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.398744:0:16295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9d34939/0x7f1093851e2da8ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe5e expref: 8 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.398752:0:16295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844814.398767:0:16295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844814.398772:0:16295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 8 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.398807:0:16295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b9d34939/0x7f1093851e2da8ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe5e expref: 8 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.398821:0:16295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b9d34939/0x7f1093851e2da8ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe5e expref: 8 pid: 15043 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844814.398835:0:16295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16295:1875739267941760:192.168.204.43@tcp:104: 00000100:00100000:1.0:1788844814.398922:0:16295:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eed9bb5d80 going to sleep for 11 seconds 00010000:00010000:3.0:1788844814.404445:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.404464:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.404483:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.404489:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:3.0:1788844814.404494:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.404503:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.404524:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:3.0:1788844814.404575:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788844814.404581:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.404588:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec0025200/0x7f1093851e2da8f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844814.405217:0:16295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16295:1875739267941760:192.168.204.43@tcp:104: 00010000:00010000:1.0:1788844814.405252:0:16295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 8 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.405271:0:16295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91eed0d61200, rc 0) 00000100:00100000:1.0:1788844814.405326:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+8:14497:x1875739244886656:12345-192.168.204.43@tcp:101:lhsmtool_posix.0 Request processed in 6643us (9913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844814.405334:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 17 00000100:00100000:1.0:1788844814.410434:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844814.410582:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244886784 00000100:00100000:2.0:1788844814.410593:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244886784 00010000:00010000:2.0:1788844814.410639:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d34939/0x7f1093851e2da8ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe5e expref: 8 pid: 15043 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844814.410687:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:2.0:1788844814.410698:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+8:2354:x1875739244886784:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788844814.410712:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788844814.410731:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b9d34939/0x7f1093851e2da8ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe5e expref: 8 pid: 15043 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.410744:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b9d34939/0x7f1093851e2da8ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe5e expref: 8 pid: 15043 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.410783:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9d34939/0x7f1093851e2da8ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe5e expref: 8 pid: 15043 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.410801:0:14345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844814.410805:0:14345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844814.410811:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 7 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.410820:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 7 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.410859:0:14345:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 7 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844814.410873:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3172680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14345:1875739267941888:192.168.204.43@tcp:105: 00000100:00100000:2.0:1788844814.410948:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec57eb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788844814.421019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844814.421104:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3172680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14345:1875739267941888:192.168.204.43@tcp:105: 00010000:00010000:2.0:1788844814.421131:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788844814.421190:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:2354:x1875739244886784:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 10493us (10766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844814.421201:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 13 00000100:00100000:0.0:1788844814.421275:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244886912 00000100:00100000:0.0:1788844814.421283:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244886912 00000100:00100000:0.0:1788844814.421338:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:0.0:1788844814.421348:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:2355:x1875739244886912:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788844814.421591:0:15046:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788844814.421596:0:15046:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788844813 00002000:00010000:0.0:1788844814.421598:0:15046:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788844812 00002000:00010000:0.0:1788844814.421600:0:15046:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788844813 -> 1788844813 00002000:00010000:0.0:1788844814.421603:0:15046:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788844814.421630:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+8:2355:x1875739244886912:12345-192.168.204.43@tcp:2:lhsmtool_posix.0 Request processed in 283us (621us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788844814.421652:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 18 00000100:00100000:3.0:1788844814.425399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844814.425487:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244887040 00000100:00100000:2.0:1788844814.425497:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244887040 00000100:00100000:2.0:1788844814.425582:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:2.0:1788844814.425603:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+8:2357:x1875739244887040:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788844814.425645:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.425666:0:15045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 8 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.425675:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844814.425679:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788844814.425683:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.425716:0:15045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 8 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.425730:0:15045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 8 pid: 16295 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844814.425743:0:15045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3172680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15045:1875739267942016:192.168.204.43@tcp:104: 00000100:00100000:2.0:1788844814.425821:0:15045:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec57eb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788844814.428674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844814.428751:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244887168 00000100:00100000:3.0:1788844814.428761:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244887168 00010000:00010000:3.0:1788844814.428801:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 9 pid: 16295 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844814.428832:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 14 00000100:00100000:3.0:1788844814.428840:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:2355:x1875739244887168:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788844814.428896:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788844814.428921:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 9 pid: 16295 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.428936:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 9 pid: 16295 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.428964:0:14344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844814.428969:0:14344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788844814.428977:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.428988:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.429034:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788844814.429088:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:2355:x1875739244887168:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 248us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844814.429095:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 14 00010000:00010000:2.0:1788844814.429238:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da8fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe65 expref: 8 pid: 16295 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844814.429254:0:15045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3172680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15045:1875739267942016:192.168.204.43@tcp:104: 00010000:00010000:2.0:1788844814.429276:0:15045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.429293:0:15045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.429300:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.429321:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.429329:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.429337:0:15045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.429345:0:15045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844814.429349:0:15045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.429358:0:15045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.429369:0:15045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.429389:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4d2c71a/0x7f1093851e2da902 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844814.429434:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb06b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:2357:x1875739244887040:12345-192.168.204.43@tcp:1:lhsmtool_posix.0 Request processed in 3833us (4045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844814.429441:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 19 00000100:00100000:1.0:1788844814.434925:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.439614:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244887424 00000100:00100000:0.0:1788844814.439630:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244887424 00000100:00100000:0.0:1788844814.439712:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 53 00000100:00100000:0.0:1788844814.439723:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:14497:x1875739244887424:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788844814.439805:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da909 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.439823:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da909 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.439835:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da909 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.440088:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.440100:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da8d8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe50 expref: 15 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.440109:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.440146:0:14358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da8d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe50 expref: 15 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.440161:0:14358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da8d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe50 expref: 15 pid: 14358 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844814.440190:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3e21c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267942144:192.168.204.43@tcp:104: 00000100:00100000:0.0:1788844814.440282:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec7050f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788844814.442160:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3e21c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267942144:192.168.204.43@tcp:104: 00010000:00010000:0.0:1788844814.442187:0:14358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844814.444487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.444720:0:16477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244887552 00000100:00100000:0.0:1788844814.444730:0:16477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244887552 00010000:00010000:0.0:1788844814.444771:0:16477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da8d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe50 expref: 16 pid: 14358 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844814.444815:0:16477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 15 00000100:00100000:0.0:1788844814.444826:0:16477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:2355:x1875739244887552:12345-192.168.204.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788844814.444973:0:16477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788844814.444982:0:16477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da8d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe50 expref: 16 pid: 14358 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.444996:0:16477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da8d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe50 expref: 16 pid: 14358 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.445019:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526600/0x7f1093851e2da8d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe50 expref: 16 pid: 14358 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.445034:0:16477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:0.0:1788844814.445039:0:16477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.445058:0:16477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.445066:0:16477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.445097:0:16477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788844814.445194:0:16477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:2355:x1875739244887552:12345-192.168.204.43@tcp:103:ldlm_bl.0 Request processed in 369us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.445202:0:16477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 15 00010000:00010000:1.0:1788844814.445323:0:14358:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.445332:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788844814.445533:0:14358:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788844814.445724:0:14358:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788844814.445790:0:14358:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788844814.445889:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14358:1875739267942272:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788844814.446133:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844814.446167:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788844814.446362:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267942272 00000100:00100000:0.0:1788844814.446369:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267942272 00000100:00100000:0.0:1788844814.446412:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788844814.446420:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14358:x1875739267942272:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788844814.446504:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14358:x1875739267942272:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.446512:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788844814.446902:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14358:1875739267942272:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788844814.448057:0:14358:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788844814.448143:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14358:1875739267942400:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788844814.448217:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788844814.448254:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788844814.448450:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267942400 00000100:00100000:0.0:1788844814.448458:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267942400 00000100:00100000:0.0:1788844814.448518:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788844814.448527:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14358:x1875739267942400:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788844814.448738:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14358:x1875739267942400:12345-0@lo:1000:mdt00_000.0 Request processed in 211us (520us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788844814.448746:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788844814.453907:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14358:1875739267942400:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788844814.453961:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.453973:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.453981:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.453987:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844814.453992:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454022:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454041:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:1.0:1788844814.454044:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788844814.454049:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454055:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da910 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454093:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454099:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454105:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454110:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527c00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:1.0:1788844814.454113:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454120:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454128:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:1.0:1788844814.454130:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788844814.454138:0:14358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2da86f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe34 expref: 18 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454160:0:14358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2da86f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe34 expref: 18 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454169:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2da86f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe34 expref: 18 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.454208:0:14358:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526000/0x7f1093851e2da86f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.43@tcp remote: 0x359a22b62793fe34 expref: 18 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844814.454222:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267942528:192.168.204.43@tcp:105: 00000100:00100000:1.0:1788844814.454300:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff91eec71e13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788844814.461526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844814.461702:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aeed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1875739267942528:192.168.204.43@tcp:105: 00000100:00100000:0.0:1788844814.461727:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244887680 00000100:00100000:0.0:1788844814.461735:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244887680 00000100:00100000:0.0:1788844814.461789:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 10 00000100:00100000:0.0:1788844814.461809:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec56e1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+19:14496:x1875739244887680:12345-192.168.204.43@tcp:49:dd.0 00000100:00100000:0.0:1788844814.461971:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec56e1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+19:14496:x1875739244887680:12345-192.168.204.43@tcp:49:dd.0 Request processed in 162us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844814.461978:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 10 00010000:00010000:2.0:1788844814.462629:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462643:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527c00/0x7f1093851e2da868 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462675:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da917 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462689:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da917 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462700:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da917 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462710:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da917 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462716:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da917 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462723:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da917 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462735:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d600 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844814.462803:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da917 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462813:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da917 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462825:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:2.0:1788844814.462828:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788844814.462831:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da917 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462837:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ef0170d600/0x7f1093851e2da917 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462847:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da909 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462853:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da909 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462859:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da909 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462864:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526a00 already unused, calling callback (ffffffffc21d24f0) 00010000:00010000:2.0:1788844814.462867:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da909 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462873:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da909 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462890:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91eec7351800) 00010000:00010000:2.0:1788844814.462892:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788844814.462895:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da909 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844814.462902:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5526a00/0x7f1093851e2da909 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844814.465205:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+18:14497:x1875739244887424:12345-192.168.204.43@tcp:57:lhsmtool_posix.0 Request processed in 25473us (30281us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788844814.465220:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 53 00000020:00080000:2.0:1788844814.465227:0:14358:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788844814.469025:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788844814.469035:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788844814.469067:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788844814.469083:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788844814.473482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.473590:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244887936 00000100:00100000:0.0:1788844814.473601:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244887936 00000100:00100000:0.0:1788844814.473659:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 11 00000100:00100000:0.0:1788844814.473669:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+18:14497:x1875739244887936:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788844814.475289:0:14362:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788844814.477406:0:14362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788844814.477500:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.477521:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.477533:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.477562:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.477570:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.477576:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.477607:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788844814.477718:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+20:14497:x1875739244887936:12345-192.168.204.43@tcp:35:lhsmtool_posix.0 Request processed in 4045us (4252us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788844814.477735:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 11 00000020:00080000:0.0:1788844814.477742:0:14362:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788844814.478603:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788844814.478614:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.478622:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5527600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844814.478625:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.478632:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.478647:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91eee1796c00) 00010000:00010000:3.0:1788844814.478650:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788844814.478653:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.478659:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91eec5527600/0x7f1093851e2da91e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.478673:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844814.478675:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844814.478684:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788844814.682856:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.682916:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844814.683295:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244888064 00000100:00100000:3.0:1788844814.683313:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244888064 00000100:00100000:3.0:1788844814.683409:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244888192 00000100:00100000:3.0:1788844814.683413:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244888192 00000100:00100000:3.0:1788844814.683442:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1788844814.683455:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+8:2357:x1875739244888064:12345-192.168.204.43@tcp:4:dd.0 00002000:00010000:3.0:1788844814.683589:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f9b0d, atime: 0x6a9f9b0c, ctime: 0x6a9f9b0d, blocks: 0x1 00010000:00010000:3.0:1788844814.683602:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da925 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.683621:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788844814.683628:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844814.683635:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.683651:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844814.691217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:2.0:1788844814.691323:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.691633:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788844814.691643:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788844814.692100:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244888320 00000100:00100000:2.0:1788844814.692110:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244888320 00000100:00100000:2.0:1788844814.692167:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788844814.692175:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244888448 00000100:00100000:2.0:1788844814.692179:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244888448 00000100:00100000:0.0:1788844814.692852:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:0.0:1788844814.692878:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+11:2357:x1875739244888192:12345-192.168.204.43@tcp:4:dd.0 00010000:00010000:0.0:1788844814.692921:0:16591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e4914a/0x7f1093851e2da92c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.692946:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844814.692952:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844814.692959:0:16591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e4914a/0x7f1093851e2da92c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844814.692975:0:16591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e4914a/0x7f1093851e2da92c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844814.700568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844814.700619:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844814.700650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844814.700694:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:0.0:1788844814.700752:0:15049:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788844814.700773:0:15049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788844814.702276:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788844814.702298:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244888576 00000100:00100000:2.0:1788844814.702311:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244888576 00000100:00100000:2.0:1788844814.702386:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788844814.702394:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244888704 00000100:00100000:2.0:1788844814.702398:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244888704 00000100:00100000:2.0:1788844814.702413:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788844814.702418:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244888832 00000100:00100000:2.0:1788844814.702420:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244888832 00000100:00100000:2.0:1788844814.702432:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788844814.702436:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244888960 00000100:00100000:2.0:1788844814.702439:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244888960 00000100:00100000:1.0:1788844814.705278:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:1.0:1788844814.705301:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+16:2356:x1875739244888320:12345-192.168.204.43@tcp:4:dd.0 00010000:00010000:1.0:1788844814.705347:0:16592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c46ff44d/0x7f1093851e2da933 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.705365:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844814.705368:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844814.705374:0:16592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46ff44d/0x7f1093851e2da933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844814.705388:0:16592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c46ff44d/0x7f1093851e2da933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.789181:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788844814.878806:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1788844814.878825:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1788844814.878837:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1788844814.879022:0:15050:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1788844814.879097:0:15050:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788844813 -> 1788844814 00002000:00010000:3.0:1788844814.879101:0:15050:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788844813 -> 1788844814 00002000:00010000:3.0:1788844814.879104:0:15050:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1788844814.879147:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.879164:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.879175:0:15050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.879183:0:15050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025a00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844814.879190:0:15050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.879202:0:15050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.879232:0:15050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da925 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.879242:0:15050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da925 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844814.879378:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+18:2357:x1875739244888064:12345-192.168.204.43@tcp:4:dd.0 Request processed in 195918us (196525us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788844814.879390:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 0 00000100:00100000:3.0:1788844814.879435:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:3.0:1788844814.879451:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef3172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+17:2356:x1875739244888448:12345-192.168.204.43@tcp:4:dd.0 00010000:00010000:3.0:1788844814.879517:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da93a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.879533:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788844814.879587:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844814.879596:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da93a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844814.879610:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da93a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788844815.009871:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1788844815.010655:0:16591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1788844815.010663:0:16591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:3.0:1788844815.010678:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e4914a/0x7f1093851e2da92c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.010691:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e4914a/0x7f1093851e2da92c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.010701:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e4914a/0x7f1093851e2da92c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.010710:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526600 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844815.010715:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e4914a/0x7f1093851e2da92c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.010724:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e4914a/0x7f1093851e2da92c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.010762:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e4914a/0x7f1093851e2da92c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.010769:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e4914a/0x7f1093851e2da92c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844815.010854:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:2357:x1875739244888192:12345-192.168.204.43@tcp:4:dd.0 Request processed in 317986us (327931us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788844815.010864:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 1 00000100:00100000:3.0:1788844815.010895:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:3.0:1788844815.010908:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:2356:x1875739244888576:12345-192.168.204.43@tcp:4:dd.0 00010000:00010000:3.0:1788844815.010940:0:16591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da941 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.010952:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844815.010957:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788844815.010964:0:16591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.010977:0:16591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788844815.012060:0:16592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1788844815.012074:0:16592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c46ff44d/0x7f1093851e2da933 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844815.012084:0:16592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c46ff44d/0x7f1093851e2da933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844815.012104:0:16592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c46ff44d/0x7f1093851e2da933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844815.012111:0:16592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d60a00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:0.0:1788844815.012115:0:16592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46ff44d/0x7f1093851e2da933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844815.012124:0:16592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46ff44d/0x7f1093851e2da933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844815.012139:0:16592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c46ff44d/0x7f1093851e2da933 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844815.012146:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c46ff44d/0x7f1093851e2da933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788844815.012199:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:2356:x1875739244888320:12345-192.168.204.43@tcp:4:dd.0 Request processed in 306902us (320990us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788844815.012209:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 2 00000100:00100000:0.0:1788844815.012235:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 5 00000100:00100000:0.0:1788844815.012244:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+13:2356:x1875739244888704:12345-192.168.204.43@tcp:4:dd.0 00010000:00010000:0.0:1788844815.012266:0:16592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b2faa8/0x7f1093851e2da948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844815.012275:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844815.012284:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788844815.012289:0:16592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023b2faa8/0x7f1093851e2da948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788844815.012300:0:16592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023b2faa8/0x7f1093851e2da948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788844815.129392:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1788844815.131911:0:15050:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00010000:00010000:2.0:1788844815.131935:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da93a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.131959:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da93a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.131969:0:15050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da93a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.131976:0:15050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844815.131981:0:15050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da93a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.131990:0:15050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da93a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.132013:0:15050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da93a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.132022:0:15050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d52156/0x7f1093851e2da93a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844815.132269:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef3172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+15:2356:x1875739244888448:12345-192.168.204.43@tcp:4:dd.0 Request processed in 252818us (440938us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788844815.132280:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 3 00000100:00100000:2.0:1788844815.132332:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 6 00000100:00100000:2.0:1788844815.132345:0:15050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+14:2356:x1875739244888832:12345-192.168.204.43@tcp:4:dd.0 00010000:00010000:2.0:1788844815.132380:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da94f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.132393:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844815.132397:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788844815.132405:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da94f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.132417:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da94f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788844815.205750:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:1.0:1788844815.206071:0:16591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1788844815.206077:0:16591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1788844815.206092:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da941 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844815.206105:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844815.206115:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844815.206122:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec0025a00 already unused, calling callback (ffffffffc1784420) 00010000:00010000:1.0:1788844815.206126:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844815.206136:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844815.206156:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da941 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844815.206164:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0c900de/0x7f1093851e2da941 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788844815.206275:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+12:2356:x1875739244888576:12345-192.168.204.43@tcp:4:dd.0 Request processed in 195367us (505732us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788844815.206286:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 4 00000100:00100000:1.0:1788844815.206316:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 7 00000100:00100000:1.0:1788844815.206328:0:16591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+11:2356:x1875739244888960:12345-192.168.204.43@tcp:4:dd.0 00010000:00010000:1.0:1788844815.206435:0:16591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da956 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844815.206449:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844815.206464:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788844815.206472:0:16591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788844815.206485:0:16591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.207696:0:16592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023b2faa8/0x7f1093851e2da948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.207712:0:16592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023b2faa8/0x7f1093851e2da948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.207719:0:16592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023b2faa8/0x7f1093851e2da948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.207725:0:16592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eec5526200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844815.207730:0:16592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b2faa8/0x7f1093851e2da948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.207738:0:16592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023b2faa8/0x7f1093851e2da948 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.207762:0:16592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023b2faa8/0x7f1093851e2da948 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.207770:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023b2faa8/0x7f1093851e2da948 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844815.207845:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+10:2356:x1875739244888704:12345-192.168.204.43@tcp:4:dd.0 Request processed in 195599us (507221us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788844815.207854:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 5 00000001:00080000:2.0:1788844815.250781:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1788844815.251513:0:15050:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1788844815.251532:0:15050:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1788844815.251564:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da94f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.251577:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da94f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.251587:0:15050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da94f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.251593:0:15050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ef0170d800 already unused, calling callback (ffffffffc1784420) 00010000:00010000:3.0:1788844815.251598:0:15050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da94f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.251607:0:15050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da94f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.251628:0:15050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da94f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788844815.251636:0:15050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006071679e/0x7f1093851e2da94f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788844815.251727:0:15050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+9:2356:x1875739244888832:12345-192.168.204.43@tcp:4:dd.0 Request processed in 119381us (551070us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788844815.251738:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 6 00002000:00010000:2.0:1788844815.281288:0:16591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788844815.281309:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.281321:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.281330:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.281336:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91eed0d61200 already unused, calling callback (ffffffffc1784420) 00010000:00010000:2.0:1788844815.281415:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.281426:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.281469:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da956 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788844815.281477:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beaa290c/0x7f1093851e2da956 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788844815.281610:0:16591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+7:2356:x1875739244888960:12345-192.168.204.43@tcp:4:dd.0 Request processed in 75280us (580910us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788844815.281621:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 7 00000001:00080000:3.0:1788844815.281709:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:3.0:1788844815.801838:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844816.320862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844816.320907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844816.320961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844816.320982:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844816.321007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844816.321027:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844816.321051:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.43@tcp (source: 12345-192.168.204.43@tcp) 00000100:00100000:3.0:1788844816.321081:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244889344 00000100:00100000:0.0:1788844816.321089:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244889856 00000100:00100000:3.0:1788844816.321092:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244889344 00000100:00100000:0.0:1788844816.321106:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244889856 00000100:00100000:3.0:1788844816.321497:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244889472 00000100:00100000:3.0:1788844816.321505:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244889472 00000100:00100000:1.0:1788844816.321596:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244889728 00000100:00100000:1.0:1788844816.321600:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244889728 00000100:00100000:2.0:1788844816.321697:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244889088 00000100:00100000:2.0:1788844816.321706:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244889088 00000100:00100000:2.0:1788844816.321903:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 124 00000100:00100000:2.0:1788844816.322000:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+13:2356:x1875739244889088:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844816.322200:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43808ea0-7b80-4845-b465-28f13dbe0884+13:2356:x1875739244889088:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 205us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844816.322210:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 124 00000100:00100000:2.0:1788844816.322861:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244889600 00000100:00100000:2.0:1788844816.322870:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244889600 00000100:00100000:2.0:1788844816.323163:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739244889216 00000100:00100000:2.0:1788844816.323168:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739244889216 00000100:00100000:2.0:1788844816.323211:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:2.0:1788844816.323220:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:2356:x1875739244889600:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844816.323451:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+6:2356:x1875739244889600:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 226us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844816.323460:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 30 00000100:00100000:2.0:1788844816.323502:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:2.0:1788844816.323509:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+20:2356:x1875739244889216:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844816.323579:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+20:2356:x1875739244889216:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 69us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844816.323585:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 31 00000100:00100000:2.0:1788844816.323616:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:2.0:1788844816.323625:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2356:x1875739244889344:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:2.0:1788844816.323654:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2356:x1875739244889344:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 32us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844816.323661:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 20 00000100:00100000:3.0:1788844816.326638:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1788844816.326661:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00100000:3.0:1788844816.326672:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2356:x1875739244889856:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:3.0:1788844816.326755:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2356:x1875739244889856:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 103us (5771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844816.326771:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 21 00000100:00100000:0.0:1788844816.326774:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2356:x1875739244889472:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:0.0:1788844816.326848:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ec5eacc-9ecf-4b3d-902b-23c3d0acea39+5:2356:x1875739244889472:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 171us (5818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788844816.326857:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 22 00000100:00080000:0.0:1788844816.326895:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788844816.326903:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788844816.326906:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788844816.335147:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:1.0:1788844816.335175:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2356:x1875739244889728:12345-192.168.204.43@tcp:400:kworker.0 00000100:00100000:1.0:1788844816.335295:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8582c8d7-7a12-4999-a23d-58ee6d4bb16b+5:2356:x1875739244889728:12345-192.168.204.43@tcp:400:kworker.0 Request processed in 134us (14242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844816.335303:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.43@tcp, seq: 23 00000100:00100000:1.0:1788844816.640809:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eef3173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267942656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788844816.641043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788844816.641195:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267942656 00000100:00100000:2.0:1788844816.641205:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267942656 00000100:00100000:2.0:1788844816.641310:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788844816.641321:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eec6aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267942656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788844816.641357:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788844816.641447:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eec6aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875739267942656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788844816.641455:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788844816.642065:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788844816.642099:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788844816.642105:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91eefb390700, transno 8589934595 00000004:00080000:1.0:1788844816.642157:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1788844816.642186:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eef3173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875739267942656:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788844816.827042:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788844817.477327:0:16631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:0.0:1788844817.532367:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788844817.532378:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788844817.532424:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788844817.532434:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788844817.850835:0:14346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788844818.873709:0:15463:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788844819.194258:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267942784:0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.194329:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844819.194385:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267943296:0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.194415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844819.194442:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788844819.194448:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875739267943168:0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.194470:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844819.194511:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267942912:0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.194559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844819.194579:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267943424:0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.194602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844819.194619:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788844819.194625:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eeff8b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267943040:0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.194645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844819.194674:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267942784 00000100:00100000:3.0:1788844819.194680:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267942784 00000100:00100000:3.0:1788844819.194728:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788844819.194737:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eef5c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267942784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844819.194909:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267942912 00000100:00100000:1.0:1788844819.194913:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267942912 00000100:00100000:1.0:1788844819.194953:0:16295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267943040 00000100:00100000:1.0:1788844819.194956:0:16295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267943040 00000100:00100000:1.0:1788844819.194978:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788844819.194985:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eefb390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267942912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844819.195027:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eefb390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267942912:12345-0@lo:400:kworker.0 Request processed in 42us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844819.195033:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788844819.195052:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788844819.195058:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267943040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788844819.195085:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875739267943040:12345-0@lo:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788844819.195090:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788844819.195104:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788844819.195108:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788844819.195239:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eef5c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:661a174e-3914-46cb-b31b-f72a0fba243b+19:3308:x1875739267942784:12345-0@lo:400:kworker.0 Request processed in 502us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844819.195246:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788844819.195274:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267943296 00000100:00100000:3.0:1788844819.195278:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267943296 00000100:00100000:3.0:1788844819.195308:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267943168 00000100:00100000:3.0:1788844819.195311:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267943168 00000100:00100000:3.0:1788844819.195323:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267943424 00000100:00100000:3.0:1788844819.195326:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267943424 00000100:00100000:3.0:1788844819.195339:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788844819.195346:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267943296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.195389:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875739267943296:12345-0@lo:400:kworker.0 Request processed in 30us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844819.195396:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788844819.195408:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788844819.195414:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eeff8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875739267943168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.195453:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eeff8b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875739267943168:12345-0@lo:400:kworker.0 Request processed in 39us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844819.195458:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788844819.195470:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788844819.195476:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267943424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.195501:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875739267943424:12345-0@lo:400:kworker.0 Request processed in 25us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844819.195506:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788844819.195558:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91eec6aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267943552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788844819.195585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788844819.195632:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267943040:0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.195643:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875739267942912:0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.195652:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875739267943424:0@lo:400:kworker.0 00000100:00100000:3.0:1788844819.195683:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875739267943552 00000100:00100000:3.0:1788844819.195686:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875739267943552 00000100:00100000:3.0:1788844819.195709:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788844819.195715:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91eed05f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267943552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788844819.195744:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788844819.197013:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91eed05f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875739267943552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1292us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788844819.197023:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788844819.197053:0:14354:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788844819.197199:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875739267943168:0@lo:400:kworker.0 00000100:00100000:1.0:1788844819.197210:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:661a174e-3914-46cb-b31b-f72a0fba243b:3308:1875739267942784:0@lo:400:kworker.0 00000100:00100000:1.0:1788844819.197220:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eeff8b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875739267943296:0@lo:400:kworker.0 00000100:00100000:2.0:1788844819.197893:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91eec6aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875739267943552:0@lo:13:osp-pre-1-0.0 Debug log: 30433 lines, 30433 kept, 0 dropped, 0 bad.